Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X........X.............................................X] duration: 613.062864ms FAIL (2025-08-12 09:20:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 09:20:15.642340034 (87h54m37.601437272s) [upload=91627]: Starting upload Aug 12 09:20:15.642385289 (87h54m37.601482543s) [upload=91627]: Done starting upload Aug 12 09:20:15.642491923 (87h54m37.601589161s) [upload=91627]: Uploading segments... Aug 12 09:20:15.642566980 (87h54m37.601664253s) [upload=91627]: Got next segment. Inline: true Aug 12 09:20:15.642574230 (87h54m37.601671476s) [upload=91627]: Waiting for error group managing segments... Aug 12 09:20:15.642642345 (87h54m37.601739595s) [upload=91627]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:20:15.642647587 (87h54m37.601744833s) [upload=91627]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:20:15.642651182 (87h54m37.601748427s) [upload=91627]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:20:15.795900447 (87h54m37.754997683s) [upload=91627]: Done uploading segments... Aug 12 09:20:15.795920243 (87h54m37.755017482s) [upload=91627]: Upload finished. err: <nil> Duration:* 613.093629ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................X...........................] duration: 2.547480356s FAIL (2025-08-12 09:20:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.547526033s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................X..........................] duration: 2.853473805s FAIL (2025-08-12 09:19:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.853503831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X........X.............................................] duration: 1.308900015s FAIL (2025-08-12 09:19:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.308943284s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X......................X.........................] duration: 2.846571972s FAIL (2025-08-12 09:19:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.846608244s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X........X............................................] duration: 1.395966108s FAIL (2025-08-12 09:18:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.396018878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X......................X........................] duration: 2.513661649s FAIL (2025-08-12 09:18:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.513688142s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................X.......................] duration: 2.565226257s FAIL (2025-08-12 09:18:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.565259717s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X......................X......................] duration: 2.508076844s FAIL (2025-08-12 09:18:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.508115072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X........X...........................................] duration: 834.081105ms FAIL (2025-08-12 09:17:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 834.116425ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X......................X.....................] duration: 2.291909976s FAIL (2025-08-12 09:17:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.291941195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X......................X....................] duration: 2.413161402s FAIL (2025-08-12 09:17:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.413216416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................X...................] duration: 2.475847889s FAIL (2025-08-12 09:16:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.475885935s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X........X..........................................] duration: 826.319787ms FAIL (2025-08-12 09:16:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 826.351869ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X......................X..................] duration: 2.739634026s FAIL (2025-08-12 09:16:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.739670838s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................X.................] duration: 2.76856045s FAIL (2025-08-12 09:16:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.768606125s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X........X.........................................] duration: 850.127092ms FAIL (2025-08-12 09:15:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 850.225567ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................X................] duration: 2.74786167s FAIL (2025-08-12 09:15:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.747893195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X........X........................................] duration: 844.311061ms FAIL (2025-08-12 09:15:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 844.349772ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X......................X...............] duration: 2.386413628s FAIL (2025-08-12 09:14:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.386468642s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X........X.......................................] duration: 844.334075ms FAIL (2025-08-12 09:14:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 844.421722ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X......................X..............] duration: 2.869847017s FAIL (2025-08-12 09:13:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.869888272s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration: 2.285110769s FAIL (2025-08-12 09:13:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.285208819s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X......................X............] duration: 2.940298504s FAIL (2025-08-12 09:13:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.940335271s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X........X......................................] duration: 833.672919ms FAIL (2025-08-12 09:13:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 833.702359ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X......................X...........] duration: 2.471435775s FAIL (2025-08-12 09:12:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.471470902s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X........X.....................................] duration: 820.406224ms FAIL (2025-08-12 09:11:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 820.434313ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X........X....................................] duration: 847.14577ms FAIL (2025-08-12 09:11:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 847.18272ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X......................X..........] duration: 2.49951331s FAIL (2025-08-12 09:10:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.499560387s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration: 2.457802762s FAIL (2025-08-12 09:10:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.45784136s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X........X...................................] duration: 831.030141ms FAIL (2025-08-12 09:10:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 831.063276ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X......................X........] duration: 2.428748696s FAIL (2025-08-12 09:09:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.428786189s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X........X..................................] duration: 859.080233ms FAIL (2025-08-12 09:09:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 859.11813ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X......................X.......] duration: 2.334703008s FAIL (2025-08-12 09:08:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.334803413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X........X.................................] duration: 837.209737ms FAIL (2025-08-12 09:08:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 837.246129ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X........X................................] duration: 852.569151ms FAIL (2025-08-12 09:07:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 852.617618ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X......................X......] duration: 2.560134035s FAIL (2025-08-12 09:07:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.560164759s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X........X...............................] duration: 1.655255366s FAIL (2025-08-12 09:07:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.655291131s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X......................X.....] duration: 2.47055444s FAIL (2025-08-12 09:06:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.47058638s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X........X..............................] duration: 1.005088222s FAIL (2025-08-12 09:06:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.005119107s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X......................X....] duration: 2.594981089s FAIL (2025-08-12 09:05:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.59509263s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X........X.............................] duration: 980.42624ms FAIL (2025-08-12 09:05:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 980.549114ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X........X............................] duration: 1.048391687s FAIL (2025-08-12 09:04:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.048414146s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X......................X...] duration: 3.086232561s FAIL (2025-08-12 09:04:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 3.086264413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X........X...........................] duration: 885.731361ms FAIL (2025-08-12 09:04:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 885.770126ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X......................X..] duration: 4.316262869s FAIL (2025-08-12 09:03:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 4.31640004s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X........X..........................] duration: 949.855128ms FAIL (2025-08-12 09:03:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 949.886518ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X........X.........................] duration: 1.326469293s FAIL (2025-08-12 09:03:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.326491675s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X......................X.] duration: 2.440680089s FAIL (2025-08-12 09:03:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments... Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment... Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment. Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece... Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments... Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil> Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces. Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments... Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil> Duration: 2.440734868s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X........X........................] duration: 941.215693ms FAIL (2025-08-12 09:02:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests Duration:* 941.250576ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)