Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 877.603802ms FAIL (2025-08-07 10:31:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ext segment. Inline: true Aug 7 10:22:08.930607753 (42m30.674664619s) [upload=736]: Waiting for error group managing segments... Aug 7 10:22:08.930654041 (42m30.67471089s) [upload=736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:22:08.930659735 (42m30.674716603s) [upload=736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:22:08.930663415 (42m30.67472029s) [upload=736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:22:09.091497540 (42m30.8355544s) [upload=736]: Done uploading segments... Aug 7 10:22:09.091515598 (42m30.835572449s) [upload=736]: Upload finished. err: <nil> Aug 7 10:22:40.035320711 (43m1.779377559s) [upload=745]: Starting upload Aug 7 10:22:40.035385319 (43m1.779442189s) [upload=745]: Done starting upload Aug 7 10:22:40.035464093 (43m1.77952094s) [upload=745]: Uploading segments... Aug 7 10:22:40.035516406 (43m1.779573278s) [upload=745]: Got next segment. Inline: true Aug 7 10:22:40.035521681 (43m1.779578542s) [upload=745]: Waiting for error group managing segments... Aug 7 10:22:40.035570034 (43m1.77962688s) [upload=745]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:22:40.035576036 (43m1.779632901s) [upload=745]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:22:40.035579941 (43m1.779636804s) [upload=745]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:22:40.202851414 (43m1.946908267s) [upload=745]: Done uploading segments... Aug 7 10:22:40.202869676 (43m1.946926527s) [upload=745]: Upload finished. err: <nil> Aug 7 10:23:54.868005690 (44m16.612062551s) [upload=767]: Starting upload Aug 7 10:23:54.868215067 (44m16.612271931s) [upload=767]: Done starting upload Aug 7 10:23:54.868324545 (44m16.612381395s) [upload=767]: Uploading segments... Aug 7 10:23:54.868399095 (44m16.612455964s) [upload=767]: Got next segment. Inline: true Aug 7 10:23:54.868405374 (44m16.612462234s) [upload=767]: Waiting for error group managing segments... Aug 7 10:23:54.868486917 (44m16.61254377s) [upload=767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:23:54.868495801 (44m16.612552669s) [upload=767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:23:54.868500456 (44m16.612557323s) [upload=767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:23:55.070821085 (44m16.814877942s) [upload=767]: Done uploading segments... Aug 7 10:23:55.070843878 (44m16.814900724s) [upload=767]: Upload finished. err: <nil> Aug 7 10:24:26.684213003 (44m48.428269854s) [upload=774]: Starting upload Aug 7 10:24:26.684286839 (44m48.428343699s) [upload=774]: Done starting upload Aug 7 10:24:26.684364512 (44m48.428421375s) [upload=774]: Uploading segments... Aug 7 10:24:26.684412902 (44m48.428469771s) [upload=774]: Got next segment. Inline: true Aug 7 10:24:26.684420284 (44m48.428477135s) [upload=774]: Waiting for error group managing segments... Aug 7 10:24:26.684467924 (44m48.428524784s) [upload=774]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:26.684473292 (44m48.428530153s) [upload=774]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:26.684477161 (44m48.428534014s) [upload=774]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:26.915664694 (44m48.659721558s) [upload=774]: Done uploading segments... Aug 7 10:24:26.915688586 (44m48.659745448s) [upload=774]: Upload finished. err: <nil> Aug 7 10:24:46.796304085 (45m8.540360957s) [upload=783]: Starting upload Aug 7 10:24:46.796390055 (45m8.540446915s) [upload=783]: Done starting upload Aug 7 10:24:46.796458506 (45m8.540515359s) [upload=783]: Uploading segments... Aug 7 10:24:46.796505775 (45m8.540562645s) [upload=783]: Got next segment. Inline: true Aug 7 10:24:46.796511267 (45m8.540568127s) [upload=783]: Waiting for error group managing segments... Aug 7 10:24:46.796557518 (45m8.540614378s) [upload=783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:46.796562658 (45m8.540619519s) [upload=783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:46.796565995 (45m8.540622855s) [upload=783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:47.043220917 (45m8.787277783s) [upload=783]: Done uploading segments... Aug 7 10:24:47.043259854 (45m8.787316718s) [upload=783]: Upload finished. err: <nil> Aug 7 10:25:57.691417285 (46m19.435474138s) [upload=803]: Starting upload Aug 7 10:25:57.691489985 (46m19.435546845s) [upload=803]: Done starting upload Aug 7 10:25:57.691613308 (46m19.435670163s) [upload=803]: Uploading segments... Aug 7 10:25:57.691694715 (46m19.435751584s) [upload=803]: Got next segment. Inline: true Aug 7 10:25:57.691700935 (46m19.435757795s) [upload=803]: Waiting for error group managing segments... Aug 7 10:25:57.691774510 (46m19.435831373s) [upload=803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:25:57.691780933 (46m19.435837784s) [upload=803]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:25:57.691784640 (46m19.435841501s) [upload=803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:25:58.013128364 (46m19.757185224s) [upload=803]: Done uploading segments... Aug 7 10:25:58.013146780 (46m19.757203634s) [upload=803]: Upload finished. err: <nil> Aug 7 10:26:46.591364292 (47m8.335421137s) [upload=817]: Starting upload Aug 7 10:26:46.591414365 (47m8.335471228s) [upload=817]: Done starting upload Aug 7 10:26:46.591490335 (47m8.335547182s) [upload=817]: Uploading segments... Aug 7 10:26:46.591532428 (47m8.335589293s) [upload=817]: Got next segment. Inline: true Aug 7 10:26:46.591536992 (47m8.335593855s) [upload=817]: Waiting for error group managing segments... Aug 7 10:26:46.591576930 (47m8.335633777s) [upload=817]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.591581302 (47m8.335638165s) [upload=817]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.591583864 (47m8.335640727s) [upload=817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:47.022543716 (47m8.766600579s) [upload=817]: Done uploading segments... Aug 7 10:26:47.022569551 (47m8.766626415s) [upload=817]: Upload finished. err: <nil> Aug 7 10:27:20.835167791 (47m42.579224652s) [upload=827]: Starting upload Aug 7 10:27:20.835268367 (47m42.57932523s) [upload=827]: Done starting upload Aug 7 10:27:20.835355878 (47m42.579412729s) [upload=827]: Uploading segments... Aug 7 10:27:20.835427671 (47m42.579484541s) [upload=827]: Got next segment. Inline: true Aug 7 10:27:20.835434392 (47m42.579491256s) [upload=827]: Waiting for error group managing segments... Aug 7 10:27:20.835496416 (47m42.579553266s) [upload=827]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:20.835501963 (47m42.579558815s) [upload=827]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:20.835505601 (47m42.579562462s) [upload=827]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:21.120423971 (47m42.864480824s) [upload=827]: Done uploading segments... Aug 7 10:27:21.120445363 (47m42.864502219s) [upload=827]: Upload finished. err: <nil> Aug 7 10:28:27.352689442 (48m49.096746297s) [upload=849]: Starting upload Aug 7 10:28:27.352757406 (48m49.096814267s) [upload=849]: Done starting upload Aug 7 10:28:27.352842961 (48m49.096899811s) [upload=849]: Uploading segments... Aug 7 10:28:27.352930652 (48m49.096987517s) [upload=849]: Got next segment. Inline: true Aug 7 10:28:27.352937204 (48m49.096994064s) [upload=849]: Waiting for error group managing segments... Aug 7 10:28:27.353004367 (48m49.097061218s) [upload=849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:27.353011574 (48m49.097068426s) [upload=849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:27.353015280 (48m49.097072131s) [upload=849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:27.646335343 (48m49.390392193s) [upload=849]: Done uploading segments... Aug 7 10:28:27.646354101 (48m49.390410961s) [upload=849]: Upload finished. err: <nil> Aug 7 10:29:05.713625010 (49m27.45768187s) [upload=858]: Starting upload Aug 7 10:29:05.713670258 (49m27.457727107s) [upload=858]: Done starting upload Aug 7 10:29:05.713738123 (49m27.457794974s) [upload=858]: Uploading segments... Aug 7 10:29:05.713779348 (49m27.457836217s) [upload=858]: Got next segment. Inline: true Aug 7 10:29:05.713784034 (49m27.457840893s) [upload=858]: Waiting for error group managing segments... Aug 7 10:29:05.713824768 (49m27.457881618s) [upload=858]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:05.713831372 (49m27.457888223s) [upload=858]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:05.713834931 (49m27.457891781s) [upload=858]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:05.949211308 (49m27.693268159s) [upload=858]: Done uploading segments... Aug 7 10:29:05.949229910 (49m27.693286763s) [upload=858]: Upload finished. err: <nil> Aug 7 10:29:27.265784503 (49m49.009841354s) [upload=865]: Starting upload Aug 7 10:29:27.265834988 (49m49.009891854s) [upload=865]: Done starting upload Aug 7 10:29:27.265893610 (49m49.009950464s) [upload=865]: Uploading segments... Aug 7 10:29:27.265980157 (49m49.01003702s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:27.265985556 (49m49.010042416s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:27.266049830 (49m49.010106695s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:27.266056092 (49m49.010112958s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:27.266059647 (49m49.010116511s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:28.450380434 (49m50.194437294s) [upload=865]: Done uploading segments... Aug 7 10:29:28.450406421 (49m50.194463268s) [upload=865]: Upload finished. err: <nil> Duration:* 877.638355ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration: 2.556722516s FAIL (2025-08-07 10:30:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.556753568s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.069189781s FAIL (2025-08-07 10:30:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ext segment. Inline: true Aug 7 10:22:08.930607753 (42m30.674664619s) [upload=736]: Waiting for error group managing segments... Aug 7 10:22:08.930654041 (42m30.67471089s) [upload=736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:22:08.930659735 (42m30.674716603s) [upload=736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:22:08.930663415 (42m30.67472029s) [upload=736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:22:09.091497540 (42m30.8355544s) [upload=736]: Done uploading segments... Aug 7 10:22:09.091515598 (42m30.835572449s) [upload=736]: Upload finished. err: <nil> Aug 7 10:22:40.035320711 (43m1.779377559s) [upload=745]: Starting upload Aug 7 10:22:40.035385319 (43m1.779442189s) [upload=745]: Done starting upload Aug 7 10:22:40.035464093 (43m1.77952094s) [upload=745]: Uploading segments... Aug 7 10:22:40.035516406 (43m1.779573278s) [upload=745]: Got next segment. Inline: true Aug 7 10:22:40.035521681 (43m1.779578542s) [upload=745]: Waiting for error group managing segments... Aug 7 10:22:40.035570034 (43m1.77962688s) [upload=745]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:22:40.035576036 (43m1.779632901s) [upload=745]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:22:40.035579941 (43m1.779636804s) [upload=745]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:22:40.202851414 (43m1.946908267s) [upload=745]: Done uploading segments... Aug 7 10:22:40.202869676 (43m1.946926527s) [upload=745]: Upload finished. err: <nil> Aug 7 10:23:54.868005690 (44m16.612062551s) [upload=767]: Starting upload Aug 7 10:23:54.868215067 (44m16.612271931s) [upload=767]: Done starting upload Aug 7 10:23:54.868324545 (44m16.612381395s) [upload=767]: Uploading segments... Aug 7 10:23:54.868399095 (44m16.612455964s) [upload=767]: Got next segment. Inline: true Aug 7 10:23:54.868405374 (44m16.612462234s) [upload=767]: Waiting for error group managing segments... Aug 7 10:23:54.868486917 (44m16.61254377s) [upload=767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:23:54.868495801 (44m16.612552669s) [upload=767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:23:54.868500456 (44m16.612557323s) [upload=767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:23:55.070821085 (44m16.814877942s) [upload=767]: Done uploading segments... Aug 7 10:23:55.070843878 (44m16.814900724s) [upload=767]: Upload finished. err: <nil> Aug 7 10:24:26.684213003 (44m48.428269854s) [upload=774]: Starting upload Aug 7 10:24:26.684286839 (44m48.428343699s) [upload=774]: Done starting upload Aug 7 10:24:26.684364512 (44m48.428421375s) [upload=774]: Uploading segments... Aug 7 10:24:26.684412902 (44m48.428469771s) [upload=774]: Got next segment. Inline: true Aug 7 10:24:26.684420284 (44m48.428477135s) [upload=774]: Waiting for error group managing segments... Aug 7 10:24:26.684467924 (44m48.428524784s) [upload=774]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:26.684473292 (44m48.428530153s) [upload=774]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:26.684477161 (44m48.428534014s) [upload=774]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:26.915664694 (44m48.659721558s) [upload=774]: Done uploading segments... Aug 7 10:24:26.915688586 (44m48.659745448s) [upload=774]: Upload finished. err: <nil> Aug 7 10:24:46.796304085 (45m8.540360957s) [upload=783]: Starting upload Aug 7 10:24:46.796390055 (45m8.540446915s) [upload=783]: Done starting upload Aug 7 10:24:46.796458506 (45m8.540515359s) [upload=783]: Uploading segments... Aug 7 10:24:46.796505775 (45m8.540562645s) [upload=783]: Got next segment. Inline: true Aug 7 10:24:46.796511267 (45m8.540568127s) [upload=783]: Waiting for error group managing segments... Aug 7 10:24:46.796557518 (45m8.540614378s) [upload=783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:46.796562658 (45m8.540619519s) [upload=783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:46.796565995 (45m8.540622855s) [upload=783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:47.043220917 (45m8.787277783s) [upload=783]: Done uploading segments... Aug 7 10:24:47.043259854 (45m8.787316718s) [upload=783]: Upload finished. err: <nil> Aug 7 10:25:57.691417285 (46m19.435474138s) [upload=803]: Starting upload Aug 7 10:25:57.691489985 (46m19.435546845s) [upload=803]: Done starting upload Aug 7 10:25:57.691613308 (46m19.435670163s) [upload=803]: Uploading segments... Aug 7 10:25:57.691694715 (46m19.435751584s) [upload=803]: Got next segment. Inline: true Aug 7 10:25:57.691700935 (46m19.435757795s) [upload=803]: Waiting for error group managing segments... Aug 7 10:25:57.691774510 (46m19.435831373s) [upload=803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:25:57.691780933 (46m19.435837784s) [upload=803]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:25:57.691784640 (46m19.435841501s) [upload=803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:25:58.013128364 (46m19.757185224s) [upload=803]: Done uploading segments... Aug 7 10:25:58.013146780 (46m19.757203634s) [upload=803]: Upload finished. err: <nil> Aug 7 10:26:46.591364292 (47m8.335421137s) [upload=817]: Starting upload Aug 7 10:26:46.591414365 (47m8.335471228s) [upload=817]: Done starting upload Aug 7 10:26:46.591490335 (47m8.335547182s) [upload=817]: Uploading segments... Aug 7 10:26:46.591532428 (47m8.335589293s) [upload=817]: Got next segment. Inline: true Aug 7 10:26:46.591536992 (47m8.335593855s) [upload=817]: Waiting for error group managing segments... Aug 7 10:26:46.591576930 (47m8.335633777s) [upload=817]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.591581302 (47m8.335638165s) [upload=817]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.591583864 (47m8.335640727s) [upload=817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:47.022543716 (47m8.766600579s) [upload=817]: Done uploading segments... Aug 7 10:26:47.022569551 (47m8.766626415s) [upload=817]: Upload finished. err: <nil> Aug 7 10:27:20.835167791 (47m42.579224652s) [upload=827]: Starting upload Aug 7 10:27:20.835268367 (47m42.57932523s) [upload=827]: Done starting upload Aug 7 10:27:20.835355878 (47m42.579412729s) [upload=827]: Uploading segments... Aug 7 10:27:20.835427671 (47m42.579484541s) [upload=827]: Got next segment. Inline: true Aug 7 10:27:20.835434392 (47m42.579491256s) [upload=827]: Waiting for error group managing segments... Aug 7 10:27:20.835496416 (47m42.579553266s) [upload=827]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:20.835501963 (47m42.579558815s) [upload=827]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:20.835505601 (47m42.579562462s) [upload=827]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:21.120423971 (47m42.864480824s) [upload=827]: Done uploading segments... Aug 7 10:27:21.120445363 (47m42.864502219s) [upload=827]: Upload finished. err: <nil> Aug 7 10:28:27.352689442 (48m49.096746297s) [upload=849]: Starting upload Aug 7 10:28:27.352757406 (48m49.096814267s) [upload=849]: Done starting upload Aug 7 10:28:27.352842961 (48m49.096899811s) [upload=849]: Uploading segments... Aug 7 10:28:27.352930652 (48m49.096987517s) [upload=849]: Got next segment. Inline: true Aug 7 10:28:27.352937204 (48m49.096994064s) [upload=849]: Waiting for error group managing segments... Aug 7 10:28:27.353004367 (48m49.097061218s) [upload=849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:27.353011574 (48m49.097068426s) [upload=849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:27.353015280 (48m49.097072131s) [upload=849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:27.646335343 (48m49.390392193s) [upload=849]: Done uploading segments... Aug 7 10:28:27.646354101 (48m49.390410961s) [upload=849]: Upload finished. err: <nil> Aug 7 10:29:05.713625010 (49m27.45768187s) [upload=858]: Starting upload Aug 7 10:29:05.713670258 (49m27.457727107s) [upload=858]: Done starting upload Aug 7 10:29:05.713738123 (49m27.457794974s) [upload=858]: Uploading segments... Aug 7 10:29:05.713779348 (49m27.457836217s) [upload=858]: Got next segment. Inline: true Aug 7 10:29:05.713784034 (49m27.457840893s) [upload=858]: Waiting for error group managing segments... Aug 7 10:29:05.713824768 (49m27.457881618s) [upload=858]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:05.713831372 (49m27.457888223s) [upload=858]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:05.713834931 (49m27.457891781s) [upload=858]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:05.949211308 (49m27.693268159s) [upload=858]: Done uploading segments... Aug 7 10:29:05.949229910 (49m27.693286763s) [upload=858]: Upload finished. err: <nil> Aug 7 10:29:27.265784503 (49m49.009841354s) [upload=865]: Starting upload Aug 7 10:29:27.265834988 (49m49.009891854s) [upload=865]: Done starting upload Aug 7 10:29:27.265893610 (49m49.009950464s) [upload=865]: Uploading segments... Aug 7 10:29:27.265980157 (49m49.01003702s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:27.265985556 (49m49.010042416s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:27.266049830 (49m49.010106695s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:27.266056092 (49m49.010112958s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:27.266059647 (49m49.010116511s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:28.450380434 (49m50.194437294s) [upload=865]: Done uploading segments... Aug 7 10:29:28.450406421 (49m50.194463268s) [upload=865]: Upload finished. err: <nil> Duration:* 1.069222994s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X...X.................................] duration: 2.606359762s FAIL (2025-08-07 10:29:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.606382365s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1.744664892s FAIL (2025-08-07 10:29:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ext segment. Inline: true Aug 7 10:22:08.930607753 (42m30.674664619s) [upload=736]: Waiting for error group managing segments... Aug 7 10:22:08.930654041 (42m30.67471089s) [upload=736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:22:08.930659735 (42m30.674716603s) [upload=736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:22:08.930663415 (42m30.67472029s) [upload=736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:22:09.091497540 (42m30.8355544s) [upload=736]: Done uploading segments... Aug 7 10:22:09.091515598 (42m30.835572449s) [upload=736]: Upload finished. err: <nil> Aug 7 10:22:40.035320711 (43m1.779377559s) [upload=745]: Starting upload Aug 7 10:22:40.035385319 (43m1.779442189s) [upload=745]: Done starting upload Aug 7 10:22:40.035464093 (43m1.77952094s) [upload=745]: Uploading segments... Aug 7 10:22:40.035516406 (43m1.779573278s) [upload=745]: Got next segment. Inline: true Aug 7 10:22:40.035521681 (43m1.779578542s) [upload=745]: Waiting for error group managing segments... Aug 7 10:22:40.035570034 (43m1.77962688s) [upload=745]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:22:40.035576036 (43m1.779632901s) [upload=745]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:22:40.035579941 (43m1.779636804s) [upload=745]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:22:40.202851414 (43m1.946908267s) [upload=745]: Done uploading segments... Aug 7 10:22:40.202869676 (43m1.946926527s) [upload=745]: Upload finished. err: <nil> Aug 7 10:23:54.868005690 (44m16.612062551s) [upload=767]: Starting upload Aug 7 10:23:54.868215067 (44m16.612271931s) [upload=767]: Done starting upload Aug 7 10:23:54.868324545 (44m16.612381395s) [upload=767]: Uploading segments... Aug 7 10:23:54.868399095 (44m16.612455964s) [upload=767]: Got next segment. Inline: true Aug 7 10:23:54.868405374 (44m16.612462234s) [upload=767]: Waiting for error group managing segments... Aug 7 10:23:54.868486917 (44m16.61254377s) [upload=767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:23:54.868495801 (44m16.612552669s) [upload=767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:23:54.868500456 (44m16.612557323s) [upload=767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:23:55.070821085 (44m16.814877942s) [upload=767]: Done uploading segments... Aug 7 10:23:55.070843878 (44m16.814900724s) [upload=767]: Upload finished. err: <nil> Aug 7 10:24:26.684213003 (44m48.428269854s) [upload=774]: Starting upload Aug 7 10:24:26.684286839 (44m48.428343699s) [upload=774]: Done starting upload Aug 7 10:24:26.684364512 (44m48.428421375s) [upload=774]: Uploading segments... Aug 7 10:24:26.684412902 (44m48.428469771s) [upload=774]: Got next segment. Inline: true Aug 7 10:24:26.684420284 (44m48.428477135s) [upload=774]: Waiting for error group managing segments... Aug 7 10:24:26.684467924 (44m48.428524784s) [upload=774]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:26.684473292 (44m48.428530153s) [upload=774]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:26.684477161 (44m48.428534014s) [upload=774]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:26.915664694 (44m48.659721558s) [upload=774]: Done uploading segments... Aug 7 10:24:26.915688586 (44m48.659745448s) [upload=774]: Upload finished. err: <nil> Aug 7 10:24:46.796304085 (45m8.540360957s) [upload=783]: Starting upload Aug 7 10:24:46.796390055 (45m8.540446915s) [upload=783]: Done starting upload Aug 7 10:24:46.796458506 (45m8.540515359s) [upload=783]: Uploading segments... Aug 7 10:24:46.796505775 (45m8.540562645s) [upload=783]: Got next segment. Inline: true Aug 7 10:24:46.796511267 (45m8.540568127s) [upload=783]: Waiting for error group managing segments... Aug 7 10:24:46.796557518 (45m8.540614378s) [upload=783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:46.796562658 (45m8.540619519s) [upload=783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:46.796565995 (45m8.540622855s) [upload=783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:47.043220917 (45m8.787277783s) [upload=783]: Done uploading segments... Aug 7 10:24:47.043259854 (45m8.787316718s) [upload=783]: Upload finished. err: <nil> Aug 7 10:25:57.691417285 (46m19.435474138s) [upload=803]: Starting upload Aug 7 10:25:57.691489985 (46m19.435546845s) [upload=803]: Done starting upload Aug 7 10:25:57.691613308 (46m19.435670163s) [upload=803]: Uploading segments... Aug 7 10:25:57.691694715 (46m19.435751584s) [upload=803]: Got next segment. Inline: true Aug 7 10:25:57.691700935 (46m19.435757795s) [upload=803]: Waiting for error group managing segments... Aug 7 10:25:57.691774510 (46m19.435831373s) [upload=803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:25:57.691780933 (46m19.435837784s) [upload=803]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:25:57.691784640 (46m19.435841501s) [upload=803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:25:58.013128364 (46m19.757185224s) [upload=803]: Done uploading segments... Aug 7 10:25:58.013146780 (46m19.757203634s) [upload=803]: Upload finished. err: <nil> Aug 7 10:26:46.591364292 (47m8.335421137s) [upload=817]: Starting upload Aug 7 10:26:46.591414365 (47m8.335471228s) [upload=817]: Done starting upload Aug 7 10:26:46.591490335 (47m8.335547182s) [upload=817]: Uploading segments... Aug 7 10:26:46.591532428 (47m8.335589293s) [upload=817]: Got next segment. Inline: true Aug 7 10:26:46.591536992 (47m8.335593855s) [upload=817]: Waiting for error group managing segments... Aug 7 10:26:46.591576930 (47m8.335633777s) [upload=817]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.591581302 (47m8.335638165s) [upload=817]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.591583864 (47m8.335640727s) [upload=817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:47.022543716 (47m8.766600579s) [upload=817]: Done uploading segments... Aug 7 10:26:47.022569551 (47m8.766626415s) [upload=817]: Upload finished. err: <nil> Aug 7 10:27:20.835167791 (47m42.579224652s) [upload=827]: Starting upload Aug 7 10:27:20.835268367 (47m42.57932523s) [upload=827]: Done starting upload Aug 7 10:27:20.835355878 (47m42.579412729s) [upload=827]: Uploading segments... Aug 7 10:27:20.835427671 (47m42.579484541s) [upload=827]: Got next segment. Inline: true Aug 7 10:27:20.835434392 (47m42.579491256s) [upload=827]: Waiting for error group managing segments... Aug 7 10:27:20.835496416 (47m42.579553266s) [upload=827]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:20.835501963 (47m42.579558815s) [upload=827]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:20.835505601 (47m42.579562462s) [upload=827]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:21.120423971 (47m42.864480824s) [upload=827]: Done uploading segments... Aug 7 10:27:21.120445363 (47m42.864502219s) [upload=827]: Upload finished. err: <nil> Aug 7 10:28:27.352689442 (48m49.096746297s) [upload=849]: Starting upload Aug 7 10:28:27.352757406 (48m49.096814267s) [upload=849]: Done starting upload Aug 7 10:28:27.352842961 (48m49.096899811s) [upload=849]: Uploading segments... Aug 7 10:28:27.352930652 (48m49.096987517s) [upload=849]: Got next segment. Inline: true Aug 7 10:28:27.352937204 (48m49.096994064s) [upload=849]: Waiting for error group managing segments... Aug 7 10:28:27.353004367 (48m49.097061218s) [upload=849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:27.353011574 (48m49.097068426s) [upload=849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:27.353015280 (48m49.097072131s) [upload=849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:27.646335343 (48m49.390392193s) [upload=849]: Done uploading segments... Aug 7 10:28:27.646354101 (48m49.390410961s) [upload=849]: Upload finished. err: <nil> Aug 7 10:29:05.713625010 (49m27.45768187s) [upload=858]: Starting upload Aug 7 10:29:05.713670258 (49m27.457727107s) [upload=858]: Done starting upload Aug 7 10:29:05.713738123 (49m27.457794974s) [upload=858]: Uploading segments... Aug 7 10:29:05.713779348 (49m27.457836217s) [upload=858]: Got next segment. Inline: true Aug 7 10:29:05.713784034 (49m27.457840893s) [upload=858]: Waiting for error group managing segments... Aug 7 10:29:05.713824768 (49m27.457881618s) [upload=858]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:05.713831372 (49m27.457888223s) [upload=858]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:05.713834931 (49m27.457891781s) [upload=858]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:05.949211308 (49m27.693268159s) [upload=858]: Done uploading segments... Aug 7 10:29:05.949229910 (49m27.693286763s) [upload=858]: Upload finished. err: <nil> Aug 7 10:29:27.265784503 (49m49.009841354s) [upload=865]: Starting upload Aug 7 10:29:27.265834988 (49m49.009891854s) [upload=865]: Done starting upload Aug 7 10:29:27.265893610 (49m49.009950464s) [upload=865]: Uploading segments... Aug 7 10:29:27.265980157 (49m49.01003702s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:27.265985556 (49m49.010042416s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:27.266049830 (49m49.010106695s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:27.266056092 (49m49.010112958s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:27.266059647 (49m49.010116511s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:28.450380434 (49m50.194437294s) [upload=865]: Done uploading segments... Aug 7 10:29:28.450406421 (49m50.194463268s) [upload=865]: Upload finished. err: <nil> Duration:* 1.744690157s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...X................................] duration: 2.777838046s FAIL (2025-08-07 10:29:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.777867524s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X...X...............................] duration: 2.516522455s FAIL (2025-08-07 10:28:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.516551007s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration: 2.791714946s FAIL (2025-08-07 10:28:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.791745337s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...X.............................] duration: 2.613645212s FAIL (2025-08-07 10:27:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.6136813s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X...X............................] duration: 2.705534152s FAIL (2025-08-07 10:27:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.705569517s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X...X...........................] duration: 2.705295319s FAIL (2025-08-07 10:26:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.705326374s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X...X..........................] duration: 2.717975382s FAIL (2025-08-07 10:25:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.718010326s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X...X.........................] duration: 2.48460404s FAIL (2025-08-07 10:25:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.484636978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X...X........................] duration: 2.445440937s FAIL (2025-08-07 10:24:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.44553742s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X...X.......................] duration: 2.380276143s FAIL (2025-08-07 10:23:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.380327891s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X...X......................] duration: 2.358309142s FAIL (2025-08-07 10:21:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.358407172s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X...X.....................] duration: 2.481797006s FAIL (2025-08-07 10:21:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.481828537s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X...X....................] duration: 2.42011319s FAIL (2025-08-07 10:20:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.420149824s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X...X...................] duration: 2.588240048s FAIL (2025-08-07 10:19:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.588271594s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X...X..................] duration: 2.453609872s FAIL (2025-08-07 10:19:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.453676354s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X...X.................] duration: 2.432943133s FAIL (2025-08-07 10:18:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.432973565s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X...X................] duration: 2.612044537s FAIL (2025-08-07 10:17:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.612081114s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X...X...............] duration: 2.604137285s FAIL (2025-08-07 10:17:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.604176217s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X...X..............] duration: 2.459707631s FAIL (2025-08-07 10:15:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.459735218s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X...X.............] duration: 3.098028986s FAIL (2025-08-07 10:15:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 3.098154758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X...X............] duration: 2.387464879s FAIL (2025-08-07 10:13:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.387507006s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X...X...........] duration: 2.374780152s FAIL (2025-08-07 10:12:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.374814038s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X...X..........] duration: 2.303729319s FAIL (2025-08-07 10:11:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.303784238s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X...X.........] duration: 2.371654334s FAIL (2025-08-07 10:11:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.371687794s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X...X........] duration: 2.527913401s FAIL (2025-08-07 10:11:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.527951917s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X...X.......] duration: 2.492916904s FAIL (2025-08-07 10:10:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.492977043s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X...X......] duration: 2.460034563s FAIL (2025-08-07 10:09:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.460061856s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X...X.....] duration: 2.36570156s FAIL (2025-08-07 10:07:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.365742902s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X...X....] duration: 2.335745468s FAIL (2025-08-07 10:07:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.335811412s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X...X...] duration: 2.428398968s FAIL (2025-08-07 10:06:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.428427971s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration: 2.417904065s FAIL (2025-08-07 10:05:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.417937827s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X...X.] duration: 2.593626064s FAIL (2025-08-07 10:04:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 2.593665296s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X...X] duration: 370.923542ms FAIL (2025-08-07 10:03:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== VJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304068432 (22m30.0481253s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.304764616 (22m30.048821486s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305014345 (22m30.049071208s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305477179 (22m30.049534041s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.305880205 (22m30.049937065s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306158266 (22m30.050215143s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306643910 (22m30.050700776s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.306783157 (22m30.050840018s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307230497 (22m30.051287358s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307491498 (22m30.051548362s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.307981781 (22m30.052038642s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308389560 (22m30.052446433s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.308652459 (22m30.052709331s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309135547 (22m30.053192407s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.309257766 (22m30.053314647s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Uploading piece... Aug 7 10:02:08.874893186 (22m30.618950054s) [upload=380]: Next returned nil segment Aug 7 10:02:08.874915097 (22m30.618971972s) [upload=380]: Waiting for error group managing segments... Aug 7 10:02:09.005225928 (22m30.749282796s) [noise=true , address=45.91.116.7:4017 , piece_id=E5GLWCGDFY626F5E3GDLS2TCA6GK5MYOS2V5KIQNHC5ZE5YLDIUQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.010760006 (22m30.754816867s) [noise=true , address=45.91.116.4:4945 , piece_id=PF6BROBDUO7JPAXASEQDFFQFORTKYK3AVREF6FA3X7UUOXM2GBIQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.021031093 (22m30.765087954s) [noise=true , address=45.91.116.14:4214 , piece_id=LMGKPMJEQD7E3VECR3EVWL3AVY23AGWN4CZGVZFAFCDU6AZQA66Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.027507797 (22m30.771564666s) [noise=true , address=45.91.116.8:4051 , piece_id=KTAYSDZ44536HQ67WQX5L6P4YOODNC4T7JYJM6W5CDTBF4JK7RLA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.028579515 (22m30.772636362s) [noise=true , address=45.91.116.6:4996 , piece_id=5IUK44D63DMU224SUDSCBRUE5LVXQ3CLCY66CC4NJ2PN4GKFAJHA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.036714968 (22m30.780771835s) [noise=true , address=104.36.82.62:4440 , piece_id=AKNRS7VRYKCVLQ26RDVS32OIKBVQH757VMZSIH6BUKCM6XPSGMJQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.038707196 (22m30.782764064s) [noise=true , address=104.36.82.47:4534 , piece_id=U6YYACSYCDRWKW5ZZSD3LUS6CKC3D5VPOJNYGW2MVKK4HAGM4D6Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043195674 (22m30.787252526s) [noise=true , address=104.36.82.44:4902 , piece_id=XUXM6X5EUMYQ5GIPDJBHWVFAVI5MOLVYBQFLNNQQB4AIBCTZQ4FQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.043314117 (22m30.787370987s) [noise=true , address=104.36.82.16:4304 , piece_id=YV4R4DJZASOOKKNXQL77GGAATKC7ZN6PVJWPCVJ6J5B35T37W54Q, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.053762161 (22m30.79781901s) [noise=true , address=104.36.82.45:4913 , piece_id=QIVRGZ42GACITRLL7D7KN3BMQ77SE7IST4T2KL25KWHNPTQHKYOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.061702245 (22m30.805759115s) [noise=true , address=104.36.82.61:4377 , piece_id=MXXXUKIOPFXTUUVECENSPA6646VYR232H6QHNL4QIH3EVOFYOH6A, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.064101087 (22m30.808157953s) [noise=true , address=104.36.82.5:4859 , piece_id=S56ZY6BRF67XOCQ5NGUYVY3PNAHGUO2S7VC3S7ALV5XEKSY3AIFA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.066217211 (22m30.810274061s) [noise=true , address=104.36.82.12:4184 , piece_id=7UUGLPE265H3PZRYMYTXXPDCP4NOZA2AQCW3JYPV4TXLP3JT3ZMA, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073243312 (22m30.817300179s) [noise=true , address=45.91.116.11:4135 , piece_id=G7Z2E6JAEEYCA66WPXOU3JA7GKYGU4Z7TWPPBTTMWEX67UCGAKAQ, seg_pos={0 0}, upload=380]: Done uploading piece. err: <nil> Aug 7 10:02:09.073272803 (22m30.817329668s) [seg_pos={0 0}, upload=380]: Segment reached optimal threshold of 14 pieces. Aug 7 10:02:09.073773138 (22m30.817830004s) [noise=true , address=104.36.82.46:4481 , piece_id=DGFE47MKNU6IOC6U27PUI7K5VIMDTDL254RDHGXQ5KWI7A72ESYA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp): protocol: expected piece hash; context canceled; EOF Aug 7 10:02:09.073996336 (22m30.818053198s) [noise=true , address=64.49.13.140:4505 , piece_id=KXLPZD7BC6EIINZG52FB4QRJZL2H6AKHVM3CQSKI2FXSD367QLOA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45692->64.49.13.140:4505: use of closed network connection Aug 7 10:02:09.074043859 (22m30.818100721s) [noise=true , address=64.49.13.154:4928 , piece_id=BMHYHXDJUB4A7MCSEYT2MJP67JAZBA75WCRR5IHWPP2R4LNSHXPA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32956->64.49.13.154:4928: use of closed network connection Aug 7 10:02:09.074110024 (22m30.818166887s) [noise=true , address=64.49.13.138:4487 , piece_id=RQI26IPK4BAD7CBF6QT3UMNU7FI7675BSJPBSKQBE5JGN5OM3CSA, seg_pos={0 0}, upload=380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42096->64.49.13.138:4487: use of closed network connection Aug 7 10:02:09.074136418 (22m30.818193282s) [seg_pos={0 0}, upload=380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:02:09.074239505 (22m30.818296369s) [upload=380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:02:09.074246041 (22m30.818302902s) [upload=380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:02:09.221147229 (22m30.965204101s) [upload=380]: Done uploading segments... Aug 7 10:02:09.221188224 (22m30.965245092s) [upload=380]: Upload finished. err: <nil> Aug 7 10:03:03.703687023 (23m25.447743892s) [upload=398]: Starting upload Aug 7 10:03:03.703770546 (23m25.447827427s) [upload=398]: Done starting upload Aug 7 10:03:03.703902060 (23m25.447958915s) [upload=398]: Uploading segments... Aug 7 10:03:03.704413533 (23m25.448470395s) [upload=398]: Got next segment. Inline: false Aug 7 10:03:03.704483839 (23m25.448540718s) [upload=398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:03:03.704510589 (23m25.448567459s) [upload=398]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:03:03.792999911 (23m25.537056781s) [upload=398]: Next segment err: metaclient: Too Many Requests Aug 7 10:03:03.793060680 (23m25.537117544s) [upload=398]: Done uploading segments... Aug 7 10:03:03.793084895 (23m25.537141753s) [upload=398]: Upload finished. err: metaclient: Too Many Requests Duration: 371.047726ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.331226805s FAIL (2025-08-07 10:02:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.153420567 (20m50.897477429s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154139028 (20m50.898195901s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154268548 (20m50.898325419s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154690917 (20m50.898747787s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.155054158 (20m50.899111042s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158105771 (20m50.902162642s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158536065 (20m50.902592929s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159300633 (20m50.903357494s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159602568 (20m50.903659448s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160187928 (20m50.904244797s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160580333 (20m50.904637207s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161093714 (20m50.905150586s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161526409 (20m50.905583282s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.162010536 (20m50.906067407s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.164732715 (20m50.908789586s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.165205430 (20m50.909262303s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.166478725 (20m50.91053559s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.740665361 (20m51.484722212s) [upload=345]: Next returned nil segment Aug 7 10:00:29.740684085 (20m51.484740946s) [upload=345]: Waiting for error group managing segments... Aug 7 10:00:29.890910490 (20m51.634967336s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.893687376 (20m51.63774423s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894107012 (20m51.638163869s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894239867 (20m51.638296727s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.895182551 (20m51.639239402s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.901855525 (20m51.645912371s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.903801658 (20m51.647858504s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.911731510 (20m51.65578836s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912469593 (20m51.656526461s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912590753 (20m51.656647605s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914115795 (20m51.658172649s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914683510 (20m51.658740365s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915247037 (20m51.659303888s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915375102 (20m51.659431962s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915403491 (20m51.65946036s) [seg_pos={0 0}, upload=345]: Segment reached optimal threshold of 14 pieces. Aug 7 10:00:29.916926416 (20m51.660983287s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917075096 (20m51.661131946s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VM12t6Dq6SyApviDYSSUqWnnzW3wTfA4o8VsvJaah4fLj9EWh): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917312052 (20m51.661368917s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917439020 (20m51.661495883s) [noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13TLh8dDVr5jVRzsM7McF6pzo5Ytznyn9qLaaFsi7v6HYfVytA): protocol: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection Aug 7 10:00:29.917454157 (20m51.661511026s) [seg_pos={0 0}, upload=345]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:00:29.917537180 (20m51.661594047s) [upload=345]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:00:29.917543470 (20m51.66160034s) [upload=345]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:00:30.244900885 (20m51.988957761s) [upload=345]: Done uploading segments... Aug 7 10:00:30.244923524 (20m51.988980386s) [upload=345]: Upload finished. err: <nil> Aug 7 10:00:47.691111849 (21m9.435168703s) [upload=353]: Starting upload Aug 7 10:00:47.691156699 (21m9.435213568s) [upload=353]: Done starting upload Aug 7 10:00:47.691418629 (21m9.435475479s) [upload=353]: Uploading segments... Aug 7 10:00:47.691454469 (21m9.435511338s) [upload=353]: Got next segment. Inline: false Aug 7 10:00:47.691500810 (21m9.435557659s) [upload=353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:00:47.691509653 (21m9.4355665s) [upload=353]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:00:47.788477893 (21m9.532534762s) [upload=353]: Next segment err: metaclient: Too Many Requests Aug 7 10:00:47.788511869 (21m9.532568729s) [upload=353]: Done uploading segments... Aug 7 10:00:47.788528583 (21m9.532585434s) [upload=353]: Upload finished. err: metaclient: Too Many Requests Duration: 2.33125581s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.264555482s FAIL (2025-08-07 10:01:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.153420567 (20m50.897477429s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154139028 (20m50.898195901s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154268548 (20m50.898325419s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154690917 (20m50.898747787s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.155054158 (20m50.899111042s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158105771 (20m50.902162642s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158536065 (20m50.902592929s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159300633 (20m50.903357494s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159602568 (20m50.903659448s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160187928 (20m50.904244797s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160580333 (20m50.904637207s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161093714 (20m50.905150586s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161526409 (20m50.905583282s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.162010536 (20m50.906067407s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.164732715 (20m50.908789586s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.165205430 (20m50.909262303s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.166478725 (20m50.91053559s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.740665361 (20m51.484722212s) [upload=345]: Next returned nil segment Aug 7 10:00:29.740684085 (20m51.484740946s) [upload=345]: Waiting for error group managing segments... Aug 7 10:00:29.890910490 (20m51.634967336s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.893687376 (20m51.63774423s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894107012 (20m51.638163869s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894239867 (20m51.638296727s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.895182551 (20m51.639239402s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.901855525 (20m51.645912371s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.903801658 (20m51.647858504s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.911731510 (20m51.65578836s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912469593 (20m51.656526461s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912590753 (20m51.656647605s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914115795 (20m51.658172649s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914683510 (20m51.658740365s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915247037 (20m51.659303888s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915375102 (20m51.659431962s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915403491 (20m51.65946036s) [seg_pos={0 0}, upload=345]: Segment reached optimal threshold of 14 pieces. Aug 7 10:00:29.916926416 (20m51.660983287s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917075096 (20m51.661131946s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VM12t6Dq6SyApviDYSSUqWnnzW3wTfA4o8VsvJaah4fLj9EWh): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917312052 (20m51.661368917s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917439020 (20m51.661495883s) [noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13TLh8dDVr5jVRzsM7McF6pzo5Ytznyn9qLaaFsi7v6HYfVytA): protocol: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection Aug 7 10:00:29.917454157 (20m51.661511026s) [seg_pos={0 0}, upload=345]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:00:29.917537180 (20m51.661594047s) [upload=345]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:00:29.917543470 (20m51.66160034s) [upload=345]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:00:30.244900885 (20m51.988957761s) [upload=345]: Done uploading segments... Aug 7 10:00:30.244923524 (20m51.988980386s) [upload=345]: Upload finished. err: <nil> Aug 7 10:00:47.691111849 (21m9.435168703s) [upload=353]: Starting upload Aug 7 10:00:47.691156699 (21m9.435213568s) [upload=353]: Done starting upload Aug 7 10:00:47.691418629 (21m9.435475479s) [upload=353]: Uploading segments... Aug 7 10:00:47.691454469 (21m9.435511338s) [upload=353]: Got next segment. Inline: false Aug 7 10:00:47.691500810 (21m9.435557659s) [upload=353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:00:47.691509653 (21m9.4355665s) [upload=353]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:00:47.788477893 (21m9.532534762s) [upload=353]: Next segment err: metaclient: Too Many Requests Aug 7 10:00:47.788511869 (21m9.532568729s) [upload=353]: Done uploading segments... Aug 7 10:00:47.788528583 (21m9.532585434s) [upload=353]: Upload finished. err: metaclient: Too Many Requests Duration: 2.264663002s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.404461959s FAIL (2025-08-07 10:01:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.153420567 (20m50.897477429s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154139028 (20m50.898195901s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154268548 (20m50.898325419s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154690917 (20m50.898747787s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.155054158 (20m50.899111042s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158105771 (20m50.902162642s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158536065 (20m50.902592929s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159300633 (20m50.903357494s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159602568 (20m50.903659448s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160187928 (20m50.904244797s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160580333 (20m50.904637207s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161093714 (20m50.905150586s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161526409 (20m50.905583282s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.162010536 (20m50.906067407s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.164732715 (20m50.908789586s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.165205430 (20m50.909262303s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.166478725 (20m50.91053559s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.740665361 (20m51.484722212s) [upload=345]: Next returned nil segment Aug 7 10:00:29.740684085 (20m51.484740946s) [upload=345]: Waiting for error group managing segments... Aug 7 10:00:29.890910490 (20m51.634967336s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.893687376 (20m51.63774423s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894107012 (20m51.638163869s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894239867 (20m51.638296727s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.895182551 (20m51.639239402s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.901855525 (20m51.645912371s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.903801658 (20m51.647858504s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.911731510 (20m51.65578836s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912469593 (20m51.656526461s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912590753 (20m51.656647605s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914115795 (20m51.658172649s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914683510 (20m51.658740365s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915247037 (20m51.659303888s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915375102 (20m51.659431962s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915403491 (20m51.65946036s) [seg_pos={0 0}, upload=345]: Segment reached optimal threshold of 14 pieces. Aug 7 10:00:29.916926416 (20m51.660983287s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917075096 (20m51.661131946s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VM12t6Dq6SyApviDYSSUqWnnzW3wTfA4o8VsvJaah4fLj9EWh): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917312052 (20m51.661368917s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917439020 (20m51.661495883s) [noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13TLh8dDVr5jVRzsM7McF6pzo5Ytznyn9qLaaFsi7v6HYfVytA): protocol: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection Aug 7 10:00:29.917454157 (20m51.661511026s) [seg_pos={0 0}, upload=345]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:00:29.917537180 (20m51.661594047s) [upload=345]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:00:29.917543470 (20m51.66160034s) [upload=345]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:00:30.244900885 (20m51.988957761s) [upload=345]: Done uploading segments... Aug 7 10:00:30.244923524 (20m51.988980386s) [upload=345]: Upload finished. err: <nil> Aug 7 10:00:47.691111849 (21m9.435168703s) [upload=353]: Starting upload Aug 7 10:00:47.691156699 (21m9.435213568s) [upload=353]: Done starting upload Aug 7 10:00:47.691418629 (21m9.435475479s) [upload=353]: Uploading segments... Aug 7 10:00:47.691454469 (21m9.435511338s) [upload=353]: Got next segment. Inline: false Aug 7 10:00:47.691500810 (21m9.435557659s) [upload=353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:00:47.691509653 (21m9.4355665s) [upload=353]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:00:47.788477893 (21m9.532534762s) [upload=353]: Next segment err: metaclient: Too Many Requests Aug 7 10:00:47.788511869 (21m9.532568729s) [upload=353]: Done uploading segments... Aug 7 10:00:47.788528583 (21m9.532585434s) [upload=353]: Upload finished. err: metaclient: Too Many Requests Duration: 2.404494268s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 372.645192ms FAIL (2025-08-07 10:00:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.153420567 (20m50.897477429s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154139028 (20m50.898195901s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154268548 (20m50.898325419s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.154690917 (20m50.898747787s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.155054158 (20m50.899111042s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158105771 (20m50.902162642s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.158536065 (20m50.902592929s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159300633 (20m50.903357494s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.159602568 (20m50.903659448s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160187928 (20m50.904244797s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.160580333 (20m50.904637207s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161093714 (20m50.905150586s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.161526409 (20m50.905583282s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.162010536 (20m50.906067407s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.164732715 (20m50.908789586s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.165205430 (20m50.909262303s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.166478725 (20m50.91053559s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Uploading piece... Aug 7 10:00:29.740665361 (20m51.484722212s) [upload=345]: Next returned nil segment Aug 7 10:00:29.740684085 (20m51.484740946s) [upload=345]: Waiting for error group managing segments... Aug 7 10:00:29.890910490 (20m51.634967336s) [noise=true , address=104.36.82.43:4851 , piece_id=PAJABYYX3FPXUI3THSGBKBKGGCALQAE4IPTLATSJNIZTFVIEUA2Q, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.893687376 (20m51.63774423s) [noise=true , address=104.36.82.23:4476 , piece_id=LWQQ55CLOJWPOKNSAKUYFBNIPVLXQ4URNOZK7DHOBNOEUTDKZ2HQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894107012 (20m51.638163869s) [noise=true , address=104.36.82.12:4181 , piece_id=O6QEQIZLZZLRMA6MQSLWE3NSOH4WJU3UH5DD2BMFFTZFDYBYWQNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.894239867 (20m51.638296727s) [noise=true , address=104.36.82.46:4486 , piece_id=R5LCFQSSNXYE5HVL7O3M7YTN5EVSSMR7KUKDHBN7L6ISWE3TXR5A, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.895182551 (20m51.639239402s) [noise=true , address=45.91.116.7:4038 , piece_id=H2X3HGXKZU4AUMWJQO2OFJOJGX5EX2437NHL6IKQARA7NGNMV5LA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.901855525 (20m51.645912371s) [noise=true , address=45.91.116.13:4176 , piece_id=XRY2QKFQQGYCKQ5BTHZN4W3GRYBLNNSRPHJRY7QVIZH3KSU756GA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.903801658 (20m51.647858504s) [noise=true , address=104.36.82.62:4414 , piece_id=MZ4UPC2HR2ALFXMO64PDZ6CEBN5XZFUMI72SHXXVPICDD3BBWOUQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.911731510 (20m51.65578836s) [noise=true , address=104.36.82.37:4684 , piece_id=EIIF2CSJFCSELADVIEE5K2HX7VUO4GAI67SVREQEA355B6GGARNQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912469593 (20m51.656526461s) [noise=true , address=45.91.116.9:4286 , piece_id=NBJ3OMXCI4HB6PX2RPKYBTPWKGU5X5FLORNEYCOUWKCYPOVQZHBA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.912590753 (20m51.656647605s) [noise=true , address=104.36.82.60:4342 , piece_id=NAV2HM4MJBAY3P2S6UGORK45XCB47SA2QHYBWTSXF37QLKEL42YQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914115795 (20m51.658172649s) [noise=true , address=104.36.82.8:4993 , piece_id=VHWDOFMRY5GRJCVZ74U74FQ5JMBTN2EFYUXTE2I36HTAGUN3QRGA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.914683510 (20m51.658740365s) [noise=true , address=104.36.82.52:4114 , piece_id=OYR6FXBHCETNWG2PMLNK5WXEDOKBHM44KOWRV2ED3ORXXEYEB3WA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915247037 (20m51.659303888s) [noise=true , address=104.36.82.11:4129 , piece_id=U4VDE2D5M7TLFRXJBRTXJKPXQJUXBNVDZP42CM643MFQ7HDET4AQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915375102 (20m51.659431962s) [noise=true , address=104.36.82.39:4737 , piece_id=YU4LHRINKL6XJSKEB4R2UYB5WV6MPINUW22DH2KNARTTT73C4NMA, seg_pos={0 0}, upload=345]: Done uploading piece. err: <nil> Aug 7 10:00:29.915403491 (20m51.65946036s) [seg_pos={0 0}, upload=345]: Segment reached optimal threshold of 14 pieces. Aug 7 10:00:29.916926416 (20m51.660983287s) [noise=true , address=104.36.82.61:4389 , piece_id=CP7UO2KRXPW6GID6QF2BPVN4XIUZS3D4PFYMWONYNHYEHMLPRIPQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917075096 (20m51.661131946s) [noise=true , address=104.36.82.53:4127 , piece_id=44KDWENDRQ3IKUYBMTFBM2F42WGF52ZMIQHIMMFD24FQGXDGJFZQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VM12t6Dq6SyApviDYSSUqWnnzW3wTfA4o8VsvJaah4fLj9EWh): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917312052 (20m51.661368917s) [noise=true , address=104.36.82.34:4549 , piece_id=3Z3TEFN7HUMONKM44JHV4V4PUH2OZ4ZUN5NDMYR3KCNOTPLQYCGQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF Aug 7 10:00:29.917439020 (20m51.661495883s) [noise=true , address=64.49.13.170:4723 , piece_id=HV65V5B3Q5DKGOYBYOZYQU5VU3CPN3MVIR66LW3KIHIMEAM6G2LQ, seg_pos={0 0}, upload=345]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13TLh8dDVr5jVRzsM7McF6pzo5Ytznyn9qLaaFsi7v6HYfVytA): protocol: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52484->64.49.13.170:4723: use of closed network connection Aug 7 10:00:29.917454157 (20m51.661511026s) [seg_pos={0 0}, upload=345]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:00:29.917537180 (20m51.661594047s) [upload=345]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:00:29.917543470 (20m51.66160034s) [upload=345]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:00:30.244900885 (20m51.988957761s) [upload=345]: Done uploading segments... Aug 7 10:00:30.244923524 (20m51.988980386s) [upload=345]: Upload finished. err: <nil> Aug 7 10:00:47.691111849 (21m9.435168703s) [upload=353]: Starting upload Aug 7 10:00:47.691156699 (21m9.435213568s) [upload=353]: Done starting upload Aug 7 10:00:47.691418629 (21m9.435475479s) [upload=353]: Uploading segments... Aug 7 10:00:47.691454469 (21m9.435511338s) [upload=353]: Got next segment. Inline: false Aug 7 10:00:47.691500810 (21m9.435557659s) [upload=353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:00:47.691509653 (21m9.4355665s) [upload=353]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:00:47.788477893 (21m9.532534762s) [upload=353]: Next segment err: metaclient: Too Many Requests Aug 7 10:00:47.788511869 (21m9.532568729s) [upload=353]: Done uploading segments... Aug 7 10:00:47.788528583 (21m9.532585434s) [upload=353]: Upload finished. err: metaclient: Too Many Requests Duration: 372.679933ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.537330933s FAIL (2025-08-07 09:26:45 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 2.537364019s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.852261101s FAIL (2025-08-07 09:26:28 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 2.852284643s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.344171687s FAIL (2025-08-07 09:25:27 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 2.344199369s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.305892276s FAIL (2025-08-07 09:24:56 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 2.305919243s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 955.145114ms FAIL (2025-08-07 09:24:33 UTC) orbiter warning: operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 955.173071ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 821.903907ms FAIL (2025-08-07 09:24:06 UTC) orbiter warning: operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 821.948486ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.272591978s FAIL (2025-08-07 09:23:42 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 2.272626749s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.370380344s FAIL (2025-08-07 09:23:13 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 2.370409681s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)