Simple Log Service now features an improved MaxCompute shipping capability that supports data shipping from the moment the task is created, and includes historical data shipping. You can create multiple MaxCompute shipping tasks within a logstore.
Comparison between the new and old versions
Aspect | Data shipping to MaxCompute | |
Old version | New version | |
Time range for data shipping | Supports data shipping starting from the creation of the MaxCompute shipping task. |
|
Number of tasks | Only one MaxCompute shipping task can be created in a logstore. | Multiple MaxCompute shipping tasks can be created in a logstore. |
Not supported | Supported | |
Tags | ||
Time zone in DateTime mapping | ||
Dashboard | ||
Monitoring and alerting | ||
Job suspension or resumption | ||
Time partition format | Uses the Class SimpleDateFormat format. | Uses the strftime format. |
Invalid field | Null is displayed. | If Null is not allowed, the entire row is discarded. |
Upgrade to the new version
The old and new versions of data shipping jobs can run simultaneously. You can use the same procedure to create data shipping jobs for both versions. To upgrade to the new version, perform the following steps:
Stop the MaxCompute shipping task (old version).
Create a MaxCompute shipping task (new version).
ImportantSet the Start At parameter for the new shipping job to 5 to 15 minutes before the stop time of the old version's job (specified by the Shipping Interval parameter in the old version's shipping job). This prevents data loss, but may cause minor duplicate data.
For example, if you set the Shipping Interval parameter in the old version's shipping job to 300 seconds and stop the job at 12:00:00 on December 20, 2023, set the Start At parameter in the new version's shipping job to 2023-12-20 11:55:00.
Supported regions
The following regions support the new version of MaxCompute shipping.
Supported regions | |
China (Beijing) | Japan (Tokyo) |
China (Chengdu) | Singapore |
China (Hangzhou) | Malaysia (Kuala Lumpur) |
China (Hong Kong) | Indonesia (Jakarta) |
China (Shanghai) | Germany (Frankfurt) |
China (Shenzhen) | UK (London) |
China (Zhangjiakou) | UAE (Dubai) |
US (Silicon Valley) | US (Virginia) |