登记API类型数据源

INFO-数据传输读取API数据源数据 - 图1

返回数据示例

{
  "code" : 0,
  "data" : {
    "data" : [ {
      "name" : "6506ceefe7cf58e094b6",
      "id" : -2141266781,
      "age" : 86
    } ],
    "page_num" : 1,
    "page_size" : 1,
    "result_num" : 1,
    "sql" : null,
    "total_num" : 1048
  },
  "message" : "success"
}

GET

INFO-数据传输读取API数据源数据 - 图2 INFO-数据传输读取API数据源数据 - 图3

POST

INFO-数据传输读取API数据源数据 - 图4 INFO-数据传输读取API数据源数据 - 图5

Body示例

{
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}

预览数据

INFO-数据传输读取API数据源数据 - 图6

映射配置

数据预览成功后，来源端字段就能解析出来可选择 INFO-数据传输读取API数据源数据 - 图7

生效验证

在Driver日志搜索关键字ApiReader: ApiSplit

24/01/31 17:53:10 INFO ApiReader: uri: http://easydemo-prod-ds.163yun.com
24/01/31 17:53:10 INFO ApiParamUtils: params: {appKey=eec4f42917aa439d83ea13f970207516, timestamp=1706694611886, signature=1d9f2025af1849bf3bee921bbb619987, version=v1, Content-Type=application/json}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":1,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":1,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":1,"page_size":100}
24/01/31 17:53:10 INFO HttpClientUtils: url: http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post
24/01/31 17:53:10 INFO HttpClientUtils: content:{"use_total_num":"1","page_num":1,"page_size":100}
24/01/31 17:53:10 INFO HttpClientUtils: headers:{"signature":"1d9f2025af1849bf3bee921bbb619987","appKey":"eec4f42917aa439d83ea13f970207516","version":"v1","timestamp":"1706694611886","Content-Type":"application/json"}
24/01/31 17:53:10 INFO ApiReader: totalCount: 976
24/01/31 17:53:10 INFO ApiReader: Start paging processing...
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":1,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":1,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":2,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":2,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":3,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":3,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":4,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":4,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":5,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":5,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":6,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":6,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":7,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":7,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":8,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":8,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":9,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":9,"page_size":100}
24/01/31 17:53:10 INFO ApiParamUtils: params: {}
24/01/31 17:53:10 INFO ApiParamUtils: values: {"pageNumber":10,"offset":0,"limit":100,"pageSize":100}
24/01/31 17:53:10 INFO ApiParamUtils: newParams: {}
24/01/31 17:53:10 INFO ApiParamUtils: bodyString: {
  "use_total_num" : "1",
  "page_num" : "$(pageNumber)",
  "page_size" : "$(pageSize)"
}
24/01/31 17:53:10 INFO ApiParamUtils: replacedBodyString: {"use_total_num":"1","page_num":10,"page_size":100}
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":1,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":2,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":3,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":4,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":5,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":6,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":7,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":8,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":9,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: ApiSplit(http://easydemo-prod-ds.163yun.com/easy-data-api/dsc_support/cyz/test_transfer_post,post,{signature=1d9f2025af1849bf3bee921bbb619987, appKey=eec4f42917aa439d83ea13f970207516, version=v1, timestamp=1706694611886, Content-Type=application/json},{},{"use_total_num":"1","page_num":10,"page_size":100},)
24/01/31 17:53:10 INFO ApiReader: api splits length is 10
数据传输，API Reader，分页读取

作者：程艺哲