Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.........................X....X.............X......] duration:
847.834619ms
FAIL (2025-08-16 10:16:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:12:18.271428427 (184h46m40.230525678s) [upload=192356]: Starting upload Aug 16 10:12:18.271494040 (184h46m40.230591286s) [upload=192356]: Done starting upload Aug 16 10:12:18.271569642 (184h46m40.230666879s) [upload=192356]: Uploading segments... Aug 16 10:12:18.271611288 (184h46m40.230708542s) [upload=192356]: Got next segment. Inline: true Aug 16 10:12:18.271616893 (184h46m40.230714138s) [upload=192356]: Waiting for error group managing segments... Aug 16 10:12:18.271664079 (184h46m40.230761315s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:12:18.271669136 (184h46m40.230766381s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:12:18.271673057 (184h46m40.230770303s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:12:18.360020470 (184h46m40.319117717s) [upload=192356]: Done uploading segments... Aug 16 10:12:18.360042684 (184h46m40.319139917s) [upload=192356]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.871684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.....X.................................X.......] duration:
2.29603654s
FAIL (2025-08-16 10:15:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 2.296070299s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.........................X....X.............X.....] duration:
854.380012ms
FAIL (2025-08-16 10:15:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:12:18.271428427 (184h46m40.230525678s) [upload=192356]: Starting upload Aug 16 10:12:18.271494040 (184h46m40.230591286s) [upload=192356]: Done starting upload Aug 16 10:12:18.271569642 (184h46m40.230666879s) [upload=192356]: Uploading segments... Aug 16 10:12:18.271611288 (184h46m40.230708542s) [upload=192356]: Got next segment. Inline: true Aug 16 10:12:18.271616893 (184h46m40.230714138s) [upload=192356]: Waiting for error group managing segments... Aug 16 10:12:18.271664079 (184h46m40.230761315s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:12:18.271669136 (184h46m40.230766381s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:12:18.271673057 (184h46m40.230770303s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:12:18.360020470 (184h46m40.319117717s) [upload=192356]: Done uploading segments... Aug 16 10:12:18.360042684 (184h46m40.319139917s) [upload=192356]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.447281ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.........................X....X.............X....] duration:
810.284107ms
FAIL (2025-08-16 10:14:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:12:18.271428427 (184h46m40.230525678s) [upload=192356]: Starting upload Aug 16 10:12:18.271494040 (184h46m40.230591286s) [upload=192356]: Done starting upload Aug 16 10:12:18.271569642 (184h46m40.230666879s) [upload=192356]: Uploading segments... Aug 16 10:12:18.271611288 (184h46m40.230708542s) [upload=192356]: Got next segment. Inline: true Aug 16 10:12:18.271616893 (184h46m40.230714138s) [upload=192356]: Waiting for error group managing segments... Aug 16 10:12:18.271664079 (184h46m40.230761315s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:12:18.271669136 (184h46m40.230766381s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:12:18.271673057 (184h46m40.230770303s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:12:18.360020470 (184h46m40.319117717s) [upload=192356]: Done uploading segments... Aug 16 10:12:18.360042684 (184h46m40.319139917s) [upload=192356]: Upload finished. err: metaclient: Too Many Requests
Duration: 810.378427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X............X.....X.................................X......] duration:
2.528080098s
FAIL (2025-08-16 10:14:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 2.528142903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.........................X....X.............X...] duration:
837.652092ms
FAIL (2025-08-16 10:14:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:12:18.271428427 (184h46m40.230525678s) [upload=192356]: Starting upload Aug 16 10:12:18.271494040 (184h46m40.230591286s) [upload=192356]: Done starting upload Aug 16 10:12:18.271569642 (184h46m40.230666879s) [upload=192356]: Uploading segments... Aug 16 10:12:18.271611288 (184h46m40.230708542s) [upload=192356]: Got next segment. Inline: true Aug 16 10:12:18.271616893 (184h46m40.230714138s) [upload=192356]: Waiting for error group managing segments... Aug 16 10:12:18.271664079 (184h46m40.230761315s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:12:18.271669136 (184h46m40.230766381s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:12:18.271673057 (184h46m40.230770303s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:12:18.360020470 (184h46m40.319117717s) [upload=192356]: Done uploading segments... Aug 16 10:12:18.360042684 (184h46m40.319139917s) [upload=192356]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.684577ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.........................X....X.............X..] duration:
877.605366ms
FAIL (2025-08-16 10:14:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:12:18.271428427 (184h46m40.230525678s) [upload=192356]: Starting upload Aug 16 10:12:18.271494040 (184h46m40.230591286s) [upload=192356]: Done starting upload Aug 16 10:12:18.271569642 (184h46m40.230666879s) [upload=192356]: Uploading segments... Aug 16 10:12:18.271611288 (184h46m40.230708542s) [upload=192356]: Got next segment. Inline: true Aug 16 10:12:18.271616893 (184h46m40.230714138s) [upload=192356]: Waiting for error group managing segments... Aug 16 10:12:18.271664079 (184h46m40.230761315s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:12:18.271669136 (184h46m40.230766381s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:12:18.271673057 (184h46m40.230770303s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:12:18.360020470 (184h46m40.319117717s) [upload=192356]: Done uploading segments... Aug 16 10:12:18.360042684 (184h46m40.319139917s) [upload=192356]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.92199ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X............X.....X.................................X.....] duration:
2.560488429s
FAIL (2025-08-16 10:13:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 2.560518603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.........................X....X.............X.] duration:
822.066621ms
FAIL (2025-08-16 10:13:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:12:18.271428427 (184h46m40.230525678s) [upload=192356]: Starting upload Aug 16 10:12:18.271494040 (184h46m40.230591286s) [upload=192356]: Done starting upload Aug 16 10:12:18.271569642 (184h46m40.230666879s) [upload=192356]: Uploading segments... Aug 16 10:12:18.271611288 (184h46m40.230708542s) [upload=192356]: Got next segment. Inline: true Aug 16 10:12:18.271616893 (184h46m40.230714138s) [upload=192356]: Waiting for error group managing segments... Aug 16 10:12:18.271664079 (184h46m40.230761315s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:12:18.271669136 (184h46m40.230766381s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:12:18.271673057 (184h46m40.230770303s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:12:18.360020470 (184h46m40.319117717s) [upload=192356]: Done uploading segments... Aug 16 10:12:18.360042684 (184h46m40.319139917s) [upload=192356]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.098773ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X............X.....X.................................X....] duration:
2.389596337s
FAIL (2025-08-16 10:13:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 2.389627492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.........................X....X.............X] duration:
368.561664ms
FAIL (2025-08-16 10:12:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:12:18.271428427 (184h46m40.230525678s) [upload=192356]: Starting upload Aug 16 10:12:18.271494040 (184h46m40.230591286s) [upload=192356]: Done starting upload Aug 16 10:12:18.271569642 (184h46m40.230666879s) [upload=192356]: Uploading segments... Aug 16 10:12:18.271611288 (184h46m40.230708542s) [upload=192356]: Got next segment. Inline: true Aug 16 10:12:18.271616893 (184h46m40.230714138s) [upload=192356]: Waiting for error group managing segments... Aug 16 10:12:18.271664079 (184h46m40.230761315s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:12:18.271669136 (184h46m40.230766381s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:12:18.271673057 (184h46m40.230770303s) [upload=192356]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:12:18.360020470 (184h46m40.319117717s) [upload=192356]: Done uploading segments... Aug 16 10:12:18.360042684 (184h46m40.319139917s) [upload=192356]: Upload finished. err: metaclient: Too Many Requests
Duration: 368.614394ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X............X.....X.................................X...] duration:
2.76354898s
FAIL (2025-08-16 10:12:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 2.763603812s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........................X....X.............] duration:
2.027761209s
FAIL (2025-08-16 10:12:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.027799351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X............X.....X.................................X..] duration:
2.752314602s
FAIL (2025-08-16 10:11:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 2.752353233s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.........................X....X............] duration:
905.885822ms
FAIL (2025-08-16 10:11:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 905.929976ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........................X....X...........] duration:
813.602145ms
FAIL (2025-08-16 10:10:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.642311ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X............X.....X.................................X.] duration:
2.433494242s
FAIL (2025-08-16 10:10:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 2.433527101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.........................X....X..........] duration:
859.077058ms
FAIL (2025-08-16 10:10:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.115143ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X............X.....X.................................X] duration:
1.918798411s
FAIL (2025-08-16 10:09:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 10:09:55.100013090 (184h44m17.059110343s) [upload=192316]: Starting upload
Aug 16 10:09:55.100089393 (184h44m17.05918665s) [upload=192316]: Done starting upload
Aug 16 10:09:55.100219485 (184h44m17.059316717s) [upload=192316]: Uploading segments...
Aug 16 10:09:55.100419531 (184h44m17.059516793s) [upload=192316]: Got next segment. Inline: false
Aug 16 10:09:55.100515954 (184h44m17.05961321s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 10:09:55.100522915 (184h44m17.059620171s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 10:09:55.369406988 (184h44m17.328504236s) [seg_pos={0 0}, upload=192316]: Begin upload segment...
Aug 16 10:09:55.369480395 (184h44m17.328577633s) [seg_pos={0 0}, upload=192316]: Done begin upload segment.
Aug 16 10:09:55.369535493 (184h44m17.328632748s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.369944636 (184h44m17.329041887s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370238050 (184h44m17.329335295s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370481135 (184h44m17.329578386s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370720775 (184h44m17.329818024s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.370942310 (184h44m17.330039555s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371187564 (184h44m17.330284813s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371443770 (184h44m17.330541021s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.371675471 (184h44m17.330772716s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374056039 (184h44m17.333153327s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374488532 (184h44m17.333585792s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.374928235 (184h44m17.334025485s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375299508 (184h44m17.334396762s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375660653 (184h44m17.334757908s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.375972604 (184h44m17.335069863s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376327623 (184h44m17.335424877s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.376681585 (184h44m17.335778834s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.377002279 (184h44m17.336099534s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Uploading piece...
Aug 16 10:09:55.918377715 (184h44m17.877474969s) [upload=192316]: Next returned nil segment
Aug 16 10:09:55.918816263 (184h44m17.877913517s) [upload=192316]: Waiting for error group managing segments...
Aug 16 10:09:56.092534391 (184h44m18.051631638s) [noise=true , address=45.91.116.14:4194 , piece_id=LMFRPUZYWPT26QKXYWJTT6CKES6M2F4W4Z7OHJLTHIW6V42D6ZNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.092572462 (184h44m18.051669715s) [noise=true , address=45.91.116.5:4324 , piece_id=DFIS7OA3VEYVYLJJVZPTIGZTNLTEVOTQEUJRE55J2IQTP4NV3TUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.093568747 (184h44m18.052666002s) [noise=true , address=104.36.82.18:4369 , piece_id=46YU7YGZEMY5W5IKBWTNNVJ2NESTGUOLZU3R4PVIYJ5G4Q33RT6A, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095459883 (184h44m18.054557116s) [noise=true , address=104.36.82.18:4396 , piece_id=JMCYZMEJOUJMBMOWEDH44V5F7ITJFNHLFVSXNU4ZIBL2Q5YFDZWQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.095917727 (184h44m18.055014959s) [noise=true , address=104.36.82.60:4352 , piece_id=BGDHECZE43TZVBNVYH6GGX62Y2U543UULE24YNT3GI5ATS7MTUDQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.103792553 (184h44m18.062889785s) [noise=true , address=45.91.116.7:4025 , piece_id=H3JX5JZSRZCPQ65ZK65VSXVXJDRO2UCGCEUQJHYGHWLDUE4ODXUQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.109394936 (184h44m18.068492182s) [noise=true , address=104.36.82.37:4660 , piece_id=2C733NS6RDPNX3ACN4R4STFTIFMV6XI7KLK2QFUAPCXF7VHGYCBQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.116962833 (184h44m18.076060077s) [noise=true , address=104.36.82.39:4730 , piece_id=JBOPVSG5FVR4HKQXDVYQSOMMX3EXQCNONYTOTMFBUF7476YFMD4Q, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.141680262 (184h44m18.100777495s) [noise=true , address=104.36.82.5:4872 , piece_id=WDY2MXOQRIB6K5VU4TBRKWMS2DOMQJM5WVHQRDVO7TIX4EWYUCPQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.158134822 (184h44m18.117232069s) [noise=true , address=77.90.31.14:4683 , piece_id=IGQTIXACGEBGSTAF3737ZA2MVHXXJOMDUMRM6TJQEETEF5XTGVEA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.161395270 (184h44m18.120492526s) [noise=true , address=77.90.31.10:4539 , piece_id=MFXRKN4JRMXHL5MAD5QIPDQJGHQK2BQP7T4ZYSXGCQHAOEWJG4JQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.166491929 (184h44m18.125589183s) [noise=true , address=79.127.219.38:4025 , piece_id=Q4G3ZWEIVCCTIYRDSVIT2Y5BXDYH7S4KLEVJXZBBZBPRK6IXE7AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.170323820 (184h44m18.129421065s) [noise=true , address=104.36.82.23:4479 , piece_id=C6MVOWS2KK4HP4CEPFULCGGV4YQPJDCPM5KESTEI2VYNQGY2VDIQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188833634 (184h44m18.147930874s) [noise=true , address=45.91.116.8:4078 , piece_id=V74OOBFUS64XERA6MRIGPKO6CXAQHX7XIFIZVFK2UPM3QTKP32GA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: <nil>
Aug 16 10:09:56.188953321 (184h44m18.148050567s) [seg_pos={0 0}, upload=192316]: Segment reached optimal threshold of 14 pieces.
Aug 16 10:09:56.189263921 (184h44m18.148361166s) [noise=true , address=66.23.193.175:4564 , piece_id=SIYULOH6FV5KUHXKOJVY264SRRDXKLNORZ3TMRZ6NYRP4B6XD2LA, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55296->66.23.193.175:4564: use of closed network connection
Aug 16 10:09:56.189408396 (184h44m18.148505641s) [noise=true , address=79.127.205.234:4612 , piece_id=7VM5JFOHQZTSFIQTQCVN4PPFP6BTF6XRX6NZ4PU32WCK3ORHV5AQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35348->79.127.205.234:4612: use of closed network connection
Aug 16 10:09:56.189561719 (184h44m18.148658965s) [noise=true , address=79.127.201.215:4360 , piece_id=QOXGQJUENU4U6Y46G4SDXBQBMGZNARWSFVJGMBWYDBVFYOUPYDFQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189733757 (184h44m18.148831003s) [noise=true , address=77.90.31.15:4701 , piece_id=LYFRJN4ZHDOOU6ICSKL2GELSNU6ITROKT354X5P3FQ2OWOYUDQNQ, seg_pos={0 0}, upload=192316]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF
Aug 16 10:09:56.189749387 (184h44m18.148846639s) [seg_pos={0 0}, upload=192316]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 10:09:56.189878832 (184h44m18.148976188s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 10:09:56.189885974 (184h44m18.148983228s) [upload=192316]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 10:09:56.403217887 (184h44m18.362315136s) [upload=192316]: Done uploading segments...
Aug 16 10:09:56.403258349 (184h44m18.362355596s) [upload=192316]: Upload finished. err: <nil>
Duration: 1.918832223s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.........................X....X.........] duration:
806.753379ms
FAIL (2025-08-16 10:09:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 806.807932ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X............X.....X.................................] duration:
2.431616935s
FAIL (2025-08-16 10:08:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.431650682s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X...................X.........................X....X........] duration:
1.571847521s
FAIL (2025-08-16 10:08:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.572034473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X............X.....X................................] duration:
2.456865579s
FAIL (2025-08-16 10:08:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.456898633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X............X.....X...............................] duration:
2.530952712s
FAIL (2025-08-16 10:07:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.531268868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X...................X.........................X....X.......] duration:
793.721429ms
FAIL (2025-08-16 10:07:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 793.749213ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X............X.....X..............................] duration:
2.591234974s
FAIL (2025-08-16 10:07:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.5912697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X............X.....X.............................] duration:
2.328393634s
FAIL (2025-08-16 10:06:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.32842581s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X...................X.........................X....X......] duration:
981.064776ms
FAIL (2025-08-16 10:06:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 981.093602ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X............X.....X............................] duration:
2.369787459s
FAIL (2025-08-16 10:06:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.369824147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X...................X.........................X....X.....] duration:
1.024204837s
FAIL (2025-08-16 10:06:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.024234731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X............X.....X...........................] duration:
2.326774936s
FAIL (2025-08-16 10:05:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.326811864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X...................X.........................X....X....] duration:
892.739031ms
FAIL (2025-08-16 10:05:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.780141ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X...................X.........................X....X...] duration:
851.937281ms
FAIL (2025-08-16 10:04:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.975809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X............X.....X..........................] duration:
2.365005091s
FAIL (2025-08-16 10:04:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.365054411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X...................X.........................X....X..] duration:
813.923263ms
FAIL (2025-08-16 10:03:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.951443ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X............X.....X.........................] duration:
2.351609967s
FAIL (2025-08-16 10:03:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.351643415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X...................X.........................X....X.] duration:
817.02469ms
FAIL (2025-08-16 10:03:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.074936ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...............X............X.....X........................] duration:
2.526527087s
FAIL (2025-08-16 10:02:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.526577895s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [XX...............X............X.....X.......................] duration:
2.381289739s
FAIL (2025-08-16 10:02:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.381318149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X...................X.........................X....X] duration:
439.853713ms
FAIL (2025-08-16 10:02:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 10:02:04.635816158 (184h36m26.59491341s) [upload=192174]: Starting upload Aug 16 10:02:04.635942342 (184h36m26.595039578s) [upload=192174]: Done starting upload Aug 16 10:02:04.636074831 (184h36m26.595172068s) [upload=192174]: Uploading segments... Aug 16 10:02:04.636171110 (184h36m26.595268356s) [upload=192174]: Got next segment. Inline: true Aug 16 10:02:04.636176693 (184h36m26.595273929s) [upload=192174]: Waiting for error group managing segments... Aug 16 10:02:04.636234209 (184h36m26.595331455s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 10:02:04.636240109 (184h36m26.595337344s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 10:02:04.636243897 (184h36m26.595341142s) [upload=192174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 10:02:04.727911453 (184h36m26.687008708s) [upload=192174]: Done uploading segments... Aug 16 10:02:04.727954774 (184h36m26.687052029s) [upload=192174]: Upload finished. err: metaclient: Too Many Requests
Duration: 439.889827ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.XX...............X............X.....X......................] duration:
2.303591193s
FAIL (2025-08-16 10:01:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.303619475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................X.........................X....] duration:
818.662759ms
FAIL (2025-08-16 10:01:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 09:59:22.890128058 (184h33m44.849225293s) [upload=192124]: Starting upload
Aug 16 09:59:22.890209563 (184h33m44.849306812s) [upload=192124]: Done starting upload
Aug 16 09:59:22.890299409 (184h33m44.849396654s) [upload=192124]: Uploading segments...
Aug 16 09:59:22.890358147 (184h33m44.849455404s) [upload=192124]: Got next segment. Inline: true
Aug 16 09:59:22.890413858 (184h33m44.849511106s) [upload=192124]: Waiting for error group managing segments...
Aug 16 09:59:22.890482734 (184h33m44.849579969s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 09:59:22.890488470 (184h33m44.849585794s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 09:59:22.890492112 (184h33m44.84958936s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 09:59:23.054864447 (184h33m45.013961693s) [upload=192124]: Done uploading segments...
Aug 16 09:59:23.054902799 (184h33m45.014000051s) [upload=192124]: Upload finished. err: <nil>
Duration: 818.750068ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................X.........................X...] duration:
814.024629ms
FAIL (2025-08-16 10:00:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 09:59:22.890128058 (184h33m44.849225293s) [upload=192124]: Starting upload
Aug 16 09:59:22.890209563 (184h33m44.849306812s) [upload=192124]: Done starting upload
Aug 16 09:59:22.890299409 (184h33m44.849396654s) [upload=192124]: Uploading segments...
Aug 16 09:59:22.890358147 (184h33m44.849455404s) [upload=192124]: Got next segment. Inline: true
Aug 16 09:59:22.890413858 (184h33m44.849511106s) [upload=192124]: Waiting for error group managing segments...
Aug 16 09:59:22.890482734 (184h33m44.849579969s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 09:59:22.890488470 (184h33m44.849585794s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 09:59:22.890492112 (184h33m44.84958936s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 09:59:23.054864447 (184h33m45.013961693s) [upload=192124]: Done uploading segments...
Aug 16 09:59:23.054902799 (184h33m45.014000051s) [upload=192124]: Upload finished. err: <nil>
Duration: 814.072713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..XX...............X............X.....X.....................] duration:
2.550336524s
FAIL (2025-08-16 10:00:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.550385207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................X.........................X..] duration:
924.888284ms
FAIL (2025-08-16 10:00:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 09:59:22.890128058 (184h33m44.849225293s) [upload=192124]: Starting upload
Aug 16 09:59:22.890209563 (184h33m44.849306812s) [upload=192124]: Done starting upload
Aug 16 09:59:22.890299409 (184h33m44.849396654s) [upload=192124]: Uploading segments...
Aug 16 09:59:22.890358147 (184h33m44.849455404s) [upload=192124]: Got next segment. Inline: true
Aug 16 09:59:22.890413858 (184h33m44.849511106s) [upload=192124]: Waiting for error group managing segments...
Aug 16 09:59:22.890482734 (184h33m44.849579969s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 09:59:22.890488470 (184h33m44.849585794s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 09:59:22.890492112 (184h33m44.84958936s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 09:59:23.054864447 (184h33m45.013961693s) [upload=192124]: Done uploading segments...
Aug 16 09:59:23.054902799 (184h33m45.014000051s) [upload=192124]: Upload finished. err: <nil>
Duration: 924.949913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X..XX...............X............X.....X....................] duration:
2.48938581s
FAIL (2025-08-16 09:59:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.489422925s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X...................X.........................X.] duration:
795.921471ms
FAIL (2025-08-16 09:59:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 09:59:22.890128058 (184h33m44.849225293s) [upload=192124]: Starting upload
Aug 16 09:59:22.890209563 (184h33m44.849306812s) [upload=192124]: Done starting upload
Aug 16 09:59:22.890299409 (184h33m44.849396654s) [upload=192124]: Uploading segments...
Aug 16 09:59:22.890358147 (184h33m44.849455404s) [upload=192124]: Got next segment. Inline: true
Aug 16 09:59:22.890413858 (184h33m44.849511106s) [upload=192124]: Waiting for error group managing segments...
Aug 16 09:59:22.890482734 (184h33m44.849579969s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 09:59:22.890488470 (184h33m44.849585794s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 09:59:22.890492112 (184h33m44.84958936s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 09:59:23.054864447 (184h33m45.013961693s) [upload=192124]: Done uploading segments...
Aug 16 09:59:23.054902799 (184h33m45.014000051s) [upload=192124]: Upload finished. err: <nil>
Duration: 795.957732ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X...................X.........................X] duration:
741.934044ms
FAIL (2025-08-16 09:59:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 09:59:22.890128058 (184h33m44.849225293s) [upload=192124]: Starting upload
Aug 16 09:59:22.890209563 (184h33m44.849306812s) [upload=192124]: Done starting upload
Aug 16 09:59:22.890299409 (184h33m44.849396654s) [upload=192124]: Uploading segments...
Aug 16 09:59:22.890358147 (184h33m44.849455404s) [upload=192124]: Got next segment. Inline: true
Aug 16 09:59:22.890413858 (184h33m44.849511106s) [upload=192124]: Waiting for error group managing segments...
Aug 16 09:59:22.890482734 (184h33m44.849579969s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 09:59:22.890488470 (184h33m44.849585794s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 09:59:22.890492112 (184h33m44.84958936s) [upload=192124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 09:59:23.054864447 (184h33m45.013961693s) [upload=192124]: Done uploading segments...
Aug 16 09:59:23.054902799 (184h33m45.014000051s) [upload=192124]: Upload finished. err: <nil>
Duration: 741.978754ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X..XX...............X............X.....X...................] duration:
2.334221546s
FAIL (2025-08-16 09:58:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:43:31.509809558 (184h17m53.468906805s) [upload=191861]: Starting upload Aug 16 09:43:31.509897264 (184h17m53.468994509s) [upload=191861]: Done starting upload Aug 16 09:43:31.510028559 (184h17m53.469125796s) [upload=191861]: Uploading segments... Aug 16 09:43:31.510230062 (184h17m53.469327298s) [upload=191861]: Got next segment. Inline: false Aug 16 09:43:31.510276759 (184h17m53.469374009s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:43:31.510285618 (184h17m53.469382864s) [upload=191861]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 09:43:31.600910604 (184h17m53.560007855s) [upload=191861]: Next segment err: metaclient: Too Many Requests Aug 16 09:43:31.600958669 (184h17m53.560055914s) [upload=191861]: Done uploading segments... Aug 16 09:43:31.600974909 (184h17m53.560072154s) [upload=191861]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.334282173s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X...................X.........................] duration:
845.332074ms
FAIL (2025-08-16 09:58:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 09:40:15.063354170 (184h14m37.022451423s) [upload=191802]: Starting upload Aug 16 09:40:15.063459015 (184h14m37.022556304s) [upload=191802]: Done starting upload Aug 16 09:40:15.063587576 (184h14m37.022684824s) [upload=191802]: Uploading segments... Aug 16 09:40:15.063677162 (184h14m37.02277441s) [upload=191802]: Got next segment. Inline: true Aug 16 09:40:15.063684330 (184h14m37.022781583s) [upload=191802]: Waiting for error group managing segments... Aug 16 09:40:15.063751334 (184h14m37.022848571s) [upload=191802]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 09:40:15.063757077 (184h14m37.022854328s) [upload=191802]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 09:40:15.063760613 (184h14m37.022857864s) [upload=191802]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 09:40:15.163091979 (184h14m37.122189214s) [upload=191802]: Done uploading segments... Aug 16 09:40:15.163110202 (184h14m37.122207448s) [upload=191802]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.365828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|