Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X....X.....X......................X.....X...................] duration: 2.623541849s FAIL (2025-08-12 10:37:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.623578423s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X.X....X....................X............X..................] duration: 860.118816ms FAIL (2025-08-12 10:37:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 860.255356ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X.X....X....................X............X.................] duration: 857.538335ms FAIL (2025-08-12 10:37:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 857.567397ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X....X.....X......................X.....X..................] duration: 2.410854033s FAIL (2025-08-12 10:37:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.410976166s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X.X....X....................X............X................] duration: 823.383904ms FAIL (2025-08-12 10:36:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 823.422475ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X....X.....X......................X.....X.................] duration: 2.526050603s FAIL (2025-08-12 10:36:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.526094423s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X.X....X....................X............X...............] duration: 845.0015ms FAIL (2025-08-12 10:35:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 845.039239ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X....X.....X......................X.....X................] duration: 2.598106761s FAIL (2025-08-12 10:35:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.598139695s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X.X....X....................X............X..............] duration: 823.331485ms FAIL (2025-08-12 10:34:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 823.444636ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X....X.....X......................X.....X...............] duration: 2.643519293s FAIL (2025-08-12 10:34:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.643556341s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....X.X....X....................X............X.............] duration: 849.939302ms FAIL (2025-08-12 10:34:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 849.975346ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X....X....X.....X......................X.....X..............] duration: 2.403341893s FAIL (2025-08-12 10:34:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.40339372s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......X.X....X....................X............X............] duration: 841.330119ms FAIL (2025-08-12 10:33:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 841.416944ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......X.X....X....................X............X...........] duration: 833.101678ms FAIL (2025-08-12 10:33:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 833.136781ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X....X....X.....X......................X.....X.............] duration: 2.607203466s FAIL (2025-08-12 10:32:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.607276294s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [X.X....X....X.....X......................X.....X............] duration: 2.333788181s FAIL (2025-08-12 10:32:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.333824514s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X.X....X....................X............X..........] duration: 812.629044ms FAIL (2025-08-12 10:32:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 812.667949ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.X.X....X....X.....X......................X.....X...........] duration: 2.484855096s FAIL (2025-08-12 10:32:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.484896353s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..X.X....X....X.....X......................X.....X..........] duration: 2.555447565s FAIL (2025-08-12 10:31:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.555485311s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [X........X.X....X....................X............X.........] duration: 839.124465ms FAIL (2025-08-12 10:31:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 839.163083ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.X........X.X....X....................X............X........] duration: 825.411691ms FAIL (2025-08-12 10:30:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 825.522821ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [...X.X....X....X.....X......................X.....X.........] duration: 2.605701446s FAIL (2025-08-12 10:30:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.605740377s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..X........X.X....X....................X............X.......] duration: 847.04087ms FAIL (2025-08-12 10:30:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 847.140401ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [....X.X....X....X.....X......................X.....X........] duration: 2.362684806s FAIL (2025-08-12 10:29:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.362740179s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.....X.X....X....X.....X......................X.....X.......] duration: 2.57957054s FAIL (2025-08-12 10:29:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.579606209s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...X........X.X....X....................X............X......] duration: 921.482092ms FAIL (2025-08-12 10:29:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 921.519118ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [......X.X....X....X.....X......................X.....X......] duration: 2.441661933s FAIL (2025-08-12 10:28:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.441691835s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [....X........X.X....X....................X............X.....] duration: 981.703904ms FAIL (2025-08-12 10:28:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 981.736353ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.......X.X....X....X.....X......................X.....X.....] duration: 2.337709251s FAIL (2025-08-12 10:27:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.337737519s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.....X........X.X....X....................X............X....] duration: 821.241876ms FAIL (2025-08-12 10:27:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 821.273587ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [........X.X....X....X.....X......................X.....X....] duration: 2.396331389s FAIL (2025-08-12 10:27:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.396363669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [......X........X.X....X....................X............X...] duration: 848.238109ms FAIL (2025-08-12 10:26:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 848.268626ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.........X.X....X....X.....X......................X.....X...] duration: 2.432620031s FAIL (2025-08-12 10:26:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.432650478s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......X........X.X....X....................X............X..] duration: 993.100249ms FAIL (2025-08-12 10:26:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 993.128233ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..........X.X....X....X.....X......................X.....X..] duration: 2.40502534s FAIL (2025-08-12 10:25:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.405067703s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [...........X.X....X....X.....X......................X.....X.] duration: 2.423582906s FAIL (2025-08-12 10:25:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.423620277s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [........X........X.X....X....................X............X.] duration: 813.715312ms FAIL (2025-08-12 10:25:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 813.754647ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [............X.X....X....X.....X......................X.....X] duration: 2.049039313s FAIL (2025-08-12 10:25:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 10:25:08.714824622 (88h59m30.67392187s) [upload=92758]: Starting upload Aug 12 10:25:08.714904317 (88h59m30.674001564s) [upload=92758]: Done starting upload Aug 12 10:25:08.715152331 (88h59m30.674249569s) [upload=92758]: Uploading segments... Aug 12 10:25:08.715229988 (88h59m30.674327244s) [upload=92758]: Got next segment. Inline: false Aug 12 10:25:08.715268877 (88h59m30.674366123s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:25:08.715275274 (88h59m30.67437252s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:25:08.911217631 (88h59m30.870314889s) [seg_pos={0 0}, upload=92758]: Begin upload segment... Aug 12 10:25:08.911288830 (88h59m30.870386155s) [seg_pos={0 0}, upload=92758]: Done begin upload segment. Aug 12 10:25:08.911334179 (88h59m30.870431436s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911349410 (88h59m30.870446663s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.911422258 (88h59m30.870519517s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912076963 (88h59m30.871174222s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.912611431 (88h59m30.871708689s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913047474 (88h59m30.872144734s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913496105 (88h59m30.872593364s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.913804966 (88h59m30.872902225s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914022823 (88h59m30.873120135s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914312323 (88h59m30.873409582s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914426542 (88h59m30.873523797s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914772121 (88h59m30.87386938s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.914873627 (88h59m30.873970888s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915211079 (88h59m30.874308338s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.915683097 (88h59m30.874780356s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916096623 (88h59m30.875193878s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.916501984 (88h59m30.87559922s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:08.923822922 (88h59m30.882920179s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Uploading piece... Aug 12 10:25:09.513704082 (88h59m31.472801318s) [upload=92758]: Next returned nil segment Aug 12 10:25:09.513723630 (88h59m31.472820882s) [upload=92758]: Waiting for error group managing segments... Aug 12 10:25:09.660839572 (88h59m31.619936809s) [noise=true , address=77.90.31.13:4650 , piece_id=TRZEPWG63PIDZCYGAE4Q2O5KVLLDKDFHNM46YXO2LHVZTZKJVL6Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.661626342 (88h59m31.620723579s) [noise=true , address=77.90.31.11:4567 , piece_id=VR2FCEQWDCBOXXBUWXV4BGFBZFN2ARPRSBMZ4K36WCXMYQDZVALA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662604909 (88h59m31.621702147s) [noise=true , address=77.90.31.21:4897 , piece_id=HWPFC42J4P4I2QJD6AAHQUCVG65SFPPEVW7EJDTBZKS32DJ3RGEA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.662805922 (88h59m31.621903162s) [noise=true , address=104.36.82.44:4883 , piece_id=3RD45O3ZIEIKW7PDQFZMPVX53YPNDYIJQJYYZHLDDBI2HLDUPNJQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.678823339 (88h59m31.637920573s) [noise=true , address=104.36.82.23:4447 , piece_id=RDBJBG3BGX3GYTBNOSPP6HZBVOXLLE2YFWRIMXJHB5SVHP4G7K3Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.680017366 (88h59m31.639114599s) [noise=true , address=104.36.82.18:4396 , piece_id=7L6XZIUHFYCKLGIGCKGOTS4GOFPCPAAJ4MN3PCWMEUKGJT5TYR7Q, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681106454 (88h59m31.640203689s) [noise=true , address=104.36.82.37:4680 , piece_id=7TRBPHFWBKB6RYV2YKQGX6RDFQFKQU7VW2J57XDZLJBKNSDSYMFA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.681964228 (88h59m31.641061462s) [noise=true , address=104.36.82.62:4439 , piece_id=2O724U3V743H4EGQCMCRDWDG5VJW5MCPR2UMIL6MNB4IGEQDEDQA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.682486454 (88h59m31.641583687s) [noise=true , address=104.36.82.60:4366 , piece_id=NNPX2VCOLPW6A6EY4QPBYLXQHDIZ6HISPXDVAA36SJD2AXNTV37A, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.685063881 (88h59m31.644161114s) [noise=true , address=104.36.82.16:4312 , piece_id=NF6NUWDDU54VE7Y3L5LDCCMVRI4ZMO5DGLNBVK5N7JSZJHDUUDRQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.686867705 (88h59m31.645964937s) [noise=true , address=104.36.82.36:4625 , piece_id=KBO2OHIGWO7MRA3NAEWVPZTG3CH3B74YNGTQZ5XDEMBLPQCGCFAA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.788380241 (88h59m31.747477472s) [noise=true , address=79.127.220.98:4411 , piece_id=HFD7NZMG3CZLENJUWVITFUYCK4O2HFQYYKLK4LKI45IYOBMPAVDA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.925048602 (88h59m31.884145859s) [noise=true , address=79.127.201.215:4356 , piece_id=WVNGPMXI7FEXA2DCQLXT4RVVQJTMXDI473IYOSZ6M7OMSFHOJKNQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981733253 (88h59m31.940830486s) [noise=true , address=79.127.220.97:4376 , piece_id=6AYKF63II6SIHOCXVWZSZJ3MT7LGBMCKZVR3TPI66SAFRAUAVUIA, seg_pos={0 0}, upload=92758]: Done uploading piece. err: <nil> Aug 12 10:25:09.981768033 (88h59m31.940865281s) [seg_pos={0 0}, upload=92758]: Segment reached optimal threshold of 14 pieces. Aug 12 10:25:09.982006984 (88h59m31.941104218s) [noise=true , address=64.49.13.140:4506 , piece_id=TW3JZL4HKKOZ5PX54TTEJULWGPHTMTWQNMGHQNTGSV4RA5SSFVVQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982153657 (88h59m31.941250891s) [noise=true , address=66.23.193.175:4564 , piece_id=5T4NWGYYSN6OMDGROH7S7NPBXQBDE75CRMSXRTETR5EZG4SPY5JQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982248849 (88h59m31.941346099s) [noise=true , address=64.49.13.155:4919 , piece_id=2HMLSFE4HQMNG5AVUSC7RYD74LVDUZ5OUI6ZJWMR3JRKCAL6QBZQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xiUDnBwestk8Z8JFKMpGimtisQByMC4bJY8cZGd7PDL3ywMAL): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982336967 (88h59m31.941434199s) [noise=true , address=64.49.13.139:4480 , piece_id=II44BELZOYKKIGDTGOHN5664PJ6SKWZ66CSTZIECTCCLD25LGYKQ, seg_pos={0 0}, upload=92758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT): protocol: expected piece hash; context canceled; EOF Aug 12 10:25:09.982381811 (88h59m31.941479045s) [seg_pos={0 0}, upload=92758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:25:09.982479262 (88h59m31.941576509s) [upload=92758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:25:09.982484897 (88h59m31.941582144s) [upload=92758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:25:10.185575400 (88h59m32.144672671s) [upload=92758]: Done uploading segments... Aug 12 10:25:10.185597521 (88h59m32.144694757s) [upload=92758]: Upload finished. err: <nil> Duration: 2.049076561s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.............X.X....X....X.....X......................X.....] duration: 2.31625726s FAIL (2025-08-12 10:24:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 10:21:29.470300001 (88h55m51.429397271s) [upload=92689]: Starting upload Aug 12 10:21:29.470392837 (88h55m51.429490091s) [upload=92689]: Done starting upload Aug 12 10:21:29.470534721 (88h55m51.429631959s) [upload=92689]: Uploading segments... Aug 12 10:21:29.470752297 (88h55m51.429849543s) [upload=92689]: Got next segment. Inline: false Aug 12 10:21:29.470844191 (88h55m51.429941445s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:21:29.470851531 (88h55m51.429948782s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:21:29.666044897 (88h55m51.625142157s) [seg_pos={0 0}, upload=92689]: Begin upload segment... Aug 12 10:21:29.666115543 (88h55m51.625212797s) [seg_pos={0 0}, upload=92689]: Done begin upload segment. Aug 12 10:21:29.666156188 (88h55m51.625253438s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666192345 (88h55m51.6252896s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666725092 (88h55m51.62582234s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666756300 (88h55m51.625853556s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667160276 (88h55m51.62625753s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667281837 (88h55m51.626379116s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667734041 (88h55m51.626831295s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667769573 (88h55m51.626866843s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668099891 (88h55m51.627197138s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668134433 (88h55m51.627231688s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668486454 (88h55m51.627583693s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668801992 (88h55m51.627899248s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669253122 (88h55m51.62835038s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669622660 (88h55m51.628719916s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670042402 (88h55m51.629139657s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670090847 (88h55m51.629188107s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.674119520 (88h55m51.63321676s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.676843000 (88h55m51.635940243s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:30.239789079 (88h55m52.198886316s) [upload=92689]: Next returned nil segment Aug 12 10:21:30.239810682 (88h55m52.198907927s) [upload=92689]: Waiting for error group managing segments... Aug 12 10:21:30.380586554 (88h55m52.339683789s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.382885137 (88h55m52.341982385s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.394814430 (88h55m52.353911664s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.404701306 (88h55m52.363798551s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.405307705 (88h55m52.36440495s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.414067774 (88h55m52.373165023s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.419244565 (88h55m52.378342128s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422170753 (88h55m52.381267992s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422278689 (88h55m52.381375928s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.424819723 (88h55m52.383916963s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.433066314 (88h55m52.392163553s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440006888 (88h55m52.399104123s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440597254 (88h55m52.399694497s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576759325 (88h55m52.535856562s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576799803 (88h55m52.535897049s) [seg_pos={0 0}, upload=92689]: Segment reached optimal threshold of 14 pieces. Aug 12 10:21:30.577199112 (88h55m52.536296358s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF Aug 12 10:21:30.577396746 (88h55m52.536493991s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection Aug 12 10:21:30.577512417 (88h55m52.536609663s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection Aug 12 10:21:30.577591491 (88h55m52.536688735s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection Aug 12 10:21:30.577602944 (88h55m52.536700183s) [seg_pos={0 0}, upload=92689]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:21:30.577690553 (88h55m52.536787802s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:21:30.577695808 (88h55m52.536793053s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:21:30.728400515 (88h55m52.687497761s) [upload=92689]: Done uploading segments... Aug 12 10:21:30.728422317 (88h55m52.687519556s) [upload=92689]: Upload finished. err: <nil> Duration: 2.31638193s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..............X.X....X....X.....X......................X....] duration: 2.357857882s FAIL (2025-08-12 10:24:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 10:21:29.470300001 (88h55m51.429397271s) [upload=92689]: Starting upload Aug 12 10:21:29.470392837 (88h55m51.429490091s) [upload=92689]: Done starting upload Aug 12 10:21:29.470534721 (88h55m51.429631959s) [upload=92689]: Uploading segments... Aug 12 10:21:29.470752297 (88h55m51.429849543s) [upload=92689]: Got next segment. Inline: false Aug 12 10:21:29.470844191 (88h55m51.429941445s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:21:29.470851531 (88h55m51.429948782s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:21:29.666044897 (88h55m51.625142157s) [seg_pos={0 0}, upload=92689]: Begin upload segment... Aug 12 10:21:29.666115543 (88h55m51.625212797s) [seg_pos={0 0}, upload=92689]: Done begin upload segment. Aug 12 10:21:29.666156188 (88h55m51.625253438s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666192345 (88h55m51.6252896s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666725092 (88h55m51.62582234s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666756300 (88h55m51.625853556s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667160276 (88h55m51.62625753s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667281837 (88h55m51.626379116s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667734041 (88h55m51.626831295s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667769573 (88h55m51.626866843s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668099891 (88h55m51.627197138s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668134433 (88h55m51.627231688s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668486454 (88h55m51.627583693s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668801992 (88h55m51.627899248s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669253122 (88h55m51.62835038s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669622660 (88h55m51.628719916s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670042402 (88h55m51.629139657s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670090847 (88h55m51.629188107s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.674119520 (88h55m51.63321676s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.676843000 (88h55m51.635940243s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:30.239789079 (88h55m52.198886316s) [upload=92689]: Next returned nil segment Aug 12 10:21:30.239810682 (88h55m52.198907927s) [upload=92689]: Waiting for error group managing segments... Aug 12 10:21:30.380586554 (88h55m52.339683789s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.382885137 (88h55m52.341982385s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.394814430 (88h55m52.353911664s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.404701306 (88h55m52.363798551s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.405307705 (88h55m52.36440495s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.414067774 (88h55m52.373165023s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.419244565 (88h55m52.378342128s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422170753 (88h55m52.381267992s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422278689 (88h55m52.381375928s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.424819723 (88h55m52.383916963s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.433066314 (88h55m52.392163553s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440006888 (88h55m52.399104123s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440597254 (88h55m52.399694497s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576759325 (88h55m52.535856562s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576799803 (88h55m52.535897049s) [seg_pos={0 0}, upload=92689]: Segment reached optimal threshold of 14 pieces. Aug 12 10:21:30.577199112 (88h55m52.536296358s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF Aug 12 10:21:30.577396746 (88h55m52.536493991s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection Aug 12 10:21:30.577512417 (88h55m52.536609663s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection Aug 12 10:21:30.577591491 (88h55m52.536688735s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection Aug 12 10:21:30.577602944 (88h55m52.536700183s) [seg_pos={0 0}, upload=92689]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:21:30.577690553 (88h55m52.536787802s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:21:30.577695808 (88h55m52.536793053s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:21:30.728400515 (88h55m52.687497761s) [upload=92689]: Done uploading segments... Aug 12 10:21:30.728422317 (88h55m52.687519556s) [upload=92689]: Upload finished. err: <nil> Duration: 2.357892099s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........X........X.X....X....................X............X] duration: 369.187302ms FAIL (2025-08-12 10:24:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:24:06.501345623 (88h58m28.460442877s) [upload=92739]: Starting upload Aug 12 10:24:06.501426774 (88h58m28.460524019s) [upload=92739]: Done starting upload Aug 12 10:24:06.501517287 (88h58m28.460614522s) [upload=92739]: Uploading segments... Aug 12 10:24:06.501576458 (88h58m28.460673708s) [upload=92739]: Got next segment. Inline: true Aug 12 10:24:06.501581763 (88h58m28.46067901s) [upload=92739]: Waiting for error group managing segments... Aug 12 10:24:06.501627489 (88h58m28.460724735s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:24:06.501644876 (88h58m28.460742121s) [upload=92739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:24:06.501648940 (88h58m28.460746186s) [upload=92739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:24:06.597759264 (88h58m28.556856514s) [upload=92739]: Done uploading segments... Aug 12 10:24:06.597774389 (88h58m28.556871637s) [upload=92739]: Upload finished. err: metaclient: Too Many Requests Duration:* 369.214264ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........X........X.X....X....................X............] duration: 846.485286ms FAIL (2025-08-12 10:23:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after b04d74c32afc5b796dcfcaa2ce5d2a2bdd06030ba90a74cba15ac4527e18f59b != before 6821019dd5026fdd8c04e3f9b2218da1fcf312f446cd22f0ed9a51ca8f10a87e ======LOGS====== Aug 12 10:15:46.383444258 (88h50m8.342541512s) [upload=92591]: Starting upload Aug 12 10:15:46.383595677 (88h50m8.342692914s) [upload=92591]: Done starting upload Aug 12 10:15:46.383694859 (88h50m8.342792094s) [upload=92591]: Uploading segments... Aug 12 10:15:46.383771346 (88h50m8.342868602s) [upload=92591]: Got next segment. Inline: true Aug 12 10:15:46.383779875 (88h50m8.342877127s) [upload=92591]: Waiting for error group managing segments... Aug 12 10:15:46.383855643 (88h50m8.342952879s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:15:46.383861575 (88h50m8.342958821s) [upload=92591]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:15:46.383865558 (88h50m8.342962803s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:15:46.530693795 (88h50m8.48979104s) [upload=92591]: Done uploading segments... Aug 12 10:15:46.530712839 (88h50m8.489810076s) [upload=92591]: Upload finished. err: <nil> Duration:* 846.522248ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...............X.X....X....X.....X......................X...] duration: 2.371489046s FAIL (2025-08-12 10:23:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 10:21:29.470300001 (88h55m51.429397271s) [upload=92689]: Starting upload Aug 12 10:21:29.470392837 (88h55m51.429490091s) [upload=92689]: Done starting upload Aug 12 10:21:29.470534721 (88h55m51.429631959s) [upload=92689]: Uploading segments... Aug 12 10:21:29.470752297 (88h55m51.429849543s) [upload=92689]: Got next segment. Inline: false Aug 12 10:21:29.470844191 (88h55m51.429941445s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:21:29.470851531 (88h55m51.429948782s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:21:29.666044897 (88h55m51.625142157s) [seg_pos={0 0}, upload=92689]: Begin upload segment... Aug 12 10:21:29.666115543 (88h55m51.625212797s) [seg_pos={0 0}, upload=92689]: Done begin upload segment. Aug 12 10:21:29.666156188 (88h55m51.625253438s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666192345 (88h55m51.6252896s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666725092 (88h55m51.62582234s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666756300 (88h55m51.625853556s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667160276 (88h55m51.62625753s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667281837 (88h55m51.626379116s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667734041 (88h55m51.626831295s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667769573 (88h55m51.626866843s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668099891 (88h55m51.627197138s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668134433 (88h55m51.627231688s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668486454 (88h55m51.627583693s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668801992 (88h55m51.627899248s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669253122 (88h55m51.62835038s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669622660 (88h55m51.628719916s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670042402 (88h55m51.629139657s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670090847 (88h55m51.629188107s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.674119520 (88h55m51.63321676s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.676843000 (88h55m51.635940243s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:30.239789079 (88h55m52.198886316s) [upload=92689]: Next returned nil segment Aug 12 10:21:30.239810682 (88h55m52.198907927s) [upload=92689]: Waiting for error group managing segments... Aug 12 10:21:30.380586554 (88h55m52.339683789s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.382885137 (88h55m52.341982385s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.394814430 (88h55m52.353911664s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.404701306 (88h55m52.363798551s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.405307705 (88h55m52.36440495s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.414067774 (88h55m52.373165023s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.419244565 (88h55m52.378342128s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422170753 (88h55m52.381267992s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422278689 (88h55m52.381375928s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.424819723 (88h55m52.383916963s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.433066314 (88h55m52.392163553s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440006888 (88h55m52.399104123s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440597254 (88h55m52.399694497s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576759325 (88h55m52.535856562s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576799803 (88h55m52.535897049s) [seg_pos={0 0}, upload=92689]: Segment reached optimal threshold of 14 pieces. Aug 12 10:21:30.577199112 (88h55m52.536296358s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF Aug 12 10:21:30.577396746 (88h55m52.536493991s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection Aug 12 10:21:30.577512417 (88h55m52.536609663s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection Aug 12 10:21:30.577591491 (88h55m52.536688735s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection Aug 12 10:21:30.577602944 (88h55m52.536700183s) [seg_pos={0 0}, upload=92689]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:21:30.577690553 (88h55m52.536787802s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:21:30.577695808 (88h55m52.536793053s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:21:30.728400515 (88h55m52.687497761s) [upload=92689]: Done uploading segments... Aug 12 10:21:30.728422317 (88h55m52.687519556s) [upload=92689]: Upload finished. err: <nil> Duration: 2.37154419s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [X...............X.X....X....X.....X......................X..] duration: 2.51719895s FAIL (2025-08-12 10:22:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 10:21:29.470300001 (88h55m51.429397271s) [upload=92689]: Starting upload Aug 12 10:21:29.470392837 (88h55m51.429490091s) [upload=92689]: Done starting upload Aug 12 10:21:29.470534721 (88h55m51.429631959s) [upload=92689]: Uploading segments... Aug 12 10:21:29.470752297 (88h55m51.429849543s) [upload=92689]: Got next segment. Inline: false Aug 12 10:21:29.470844191 (88h55m51.429941445s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:21:29.470851531 (88h55m51.429948782s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:21:29.666044897 (88h55m51.625142157s) [seg_pos={0 0}, upload=92689]: Begin upload segment... Aug 12 10:21:29.666115543 (88h55m51.625212797s) [seg_pos={0 0}, upload=92689]: Done begin upload segment. Aug 12 10:21:29.666156188 (88h55m51.625253438s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666192345 (88h55m51.6252896s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666725092 (88h55m51.62582234s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666756300 (88h55m51.625853556s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667160276 (88h55m51.62625753s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667281837 (88h55m51.626379116s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667734041 (88h55m51.626831295s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667769573 (88h55m51.626866843s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668099891 (88h55m51.627197138s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668134433 (88h55m51.627231688s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668486454 (88h55m51.627583693s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668801992 (88h55m51.627899248s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669253122 (88h55m51.62835038s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669622660 (88h55m51.628719916s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670042402 (88h55m51.629139657s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670090847 (88h55m51.629188107s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.674119520 (88h55m51.63321676s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.676843000 (88h55m51.635940243s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:30.239789079 (88h55m52.198886316s) [upload=92689]: Next returned nil segment Aug 12 10:21:30.239810682 (88h55m52.198907927s) [upload=92689]: Waiting for error group managing segments... Aug 12 10:21:30.380586554 (88h55m52.339683789s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.382885137 (88h55m52.341982385s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.394814430 (88h55m52.353911664s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.404701306 (88h55m52.363798551s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.405307705 (88h55m52.36440495s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.414067774 (88h55m52.373165023s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.419244565 (88h55m52.378342128s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422170753 (88h55m52.381267992s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422278689 (88h55m52.381375928s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.424819723 (88h55m52.383916963s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.433066314 (88h55m52.392163553s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440006888 (88h55m52.399104123s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440597254 (88h55m52.399694497s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576759325 (88h55m52.535856562s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576799803 (88h55m52.535897049s) [seg_pos={0 0}, upload=92689]: Segment reached optimal threshold of 14 pieces. Aug 12 10:21:30.577199112 (88h55m52.536296358s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF Aug 12 10:21:30.577396746 (88h55m52.536493991s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection Aug 12 10:21:30.577512417 (88h55m52.536609663s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection Aug 12 10:21:30.577591491 (88h55m52.536688735s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection Aug 12 10:21:30.577602944 (88h55m52.536700183s) [seg_pos={0 0}, upload=92689]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:21:30.577690553 (88h55m52.536787802s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:21:30.577695808 (88h55m52.536793053s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:21:30.728400515 (88h55m52.687497761s) [upload=92689]: Done uploading segments... Aug 12 10:21:30.728422317 (88h55m52.687519556s) [upload=92689]: Upload finished. err: <nil> Duration: 2.517231639s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........X........X.X....X....................X...........] duration: 844.2871ms FAIL (2025-08-12 10:22:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after b04d74c32afc5b796dcfcaa2ce5d2a2bdd06030ba90a74cba15ac4527e18f59b != before 6821019dd5026fdd8c04e3f9b2218da1fcf312f446cd22f0ed9a51ca8f10a87e ======LOGS====== Aug 12 10:15:46.383444258 (88h50m8.342541512s) [upload=92591]: Starting upload Aug 12 10:15:46.383595677 (88h50m8.342692914s) [upload=92591]: Done starting upload Aug 12 10:15:46.383694859 (88h50m8.342792094s) [upload=92591]: Uploading segments... Aug 12 10:15:46.383771346 (88h50m8.342868602s) [upload=92591]: Got next segment. Inline: true Aug 12 10:15:46.383779875 (88h50m8.342877127s) [upload=92591]: Waiting for error group managing segments... Aug 12 10:15:46.383855643 (88h50m8.342952879s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:15:46.383861575 (88h50m8.342958821s) [upload=92591]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:15:46.383865558 (88h50m8.342962803s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:15:46.530693795 (88h50m8.48979104s) [upload=92591]: Done uploading segments... Aug 12 10:15:46.530712839 (88h50m8.489810076s) [upload=92591]: Upload finished. err: <nil> Duration:* 844.335638ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............X........X.X....X....................X..........] duration: 820.428316ms FAIL (2025-08-12 10:22:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after b04d74c32afc5b796dcfcaa2ce5d2a2bdd06030ba90a74cba15ac4527e18f59b != before 6821019dd5026fdd8c04e3f9b2218da1fcf312f446cd22f0ed9a51ca8f10a87e ======LOGS====== Aug 12 10:15:46.383444258 (88h50m8.342541512s) [upload=92591]: Starting upload Aug 12 10:15:46.383595677 (88h50m8.342692914s) [upload=92591]: Done starting upload Aug 12 10:15:46.383694859 (88h50m8.342792094s) [upload=92591]: Uploading segments... Aug 12 10:15:46.383771346 (88h50m8.342868602s) [upload=92591]: Got next segment. Inline: true Aug 12 10:15:46.383779875 (88h50m8.342877127s) [upload=92591]: Waiting for error group managing segments... Aug 12 10:15:46.383855643 (88h50m8.342952879s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:15:46.383861575 (88h50m8.342958821s) [upload=92591]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:15:46.383865558 (88h50m8.342962803s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:15:46.530693795 (88h50m8.48979104s) [upload=92591]: Done uploading segments... Aug 12 10:15:46.530712839 (88h50m8.489810076s) [upload=92591]: Upload finished. err: <nil> Duration:* 820.46271ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 8 out of 60 is failed (threshold=3) [XX...............X.X....X....X.....X......................X.] duration: 2.753239186s FAIL (2025-08-12 10:22:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 10:21:29.470300001 (88h55m51.429397271s) [upload=92689]: Starting upload Aug 12 10:21:29.470392837 (88h55m51.429490091s) [upload=92689]: Done starting upload Aug 12 10:21:29.470534721 (88h55m51.429631959s) [upload=92689]: Uploading segments... Aug 12 10:21:29.470752297 (88h55m51.429849543s) [upload=92689]: Got next segment. Inline: false Aug 12 10:21:29.470844191 (88h55m51.429941445s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:21:29.470851531 (88h55m51.429948782s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:21:29.666044897 (88h55m51.625142157s) [seg_pos={0 0}, upload=92689]: Begin upload segment... Aug 12 10:21:29.666115543 (88h55m51.625212797s) [seg_pos={0 0}, upload=92689]: Done begin upload segment. Aug 12 10:21:29.666156188 (88h55m51.625253438s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666192345 (88h55m51.6252896s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666725092 (88h55m51.62582234s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666756300 (88h55m51.625853556s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667160276 (88h55m51.62625753s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667281837 (88h55m51.626379116s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667734041 (88h55m51.626831295s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667769573 (88h55m51.626866843s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668099891 (88h55m51.627197138s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668134433 (88h55m51.627231688s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668486454 (88h55m51.627583693s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668801992 (88h55m51.627899248s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669253122 (88h55m51.62835038s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669622660 (88h55m51.628719916s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670042402 (88h55m51.629139657s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670090847 (88h55m51.629188107s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.674119520 (88h55m51.63321676s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.676843000 (88h55m51.635940243s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:30.239789079 (88h55m52.198886316s) [upload=92689]: Next returned nil segment Aug 12 10:21:30.239810682 (88h55m52.198907927s) [upload=92689]: Waiting for error group managing segments... Aug 12 10:21:30.380586554 (88h55m52.339683789s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.382885137 (88h55m52.341982385s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.394814430 (88h55m52.353911664s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.404701306 (88h55m52.363798551s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.405307705 (88h55m52.36440495s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.414067774 (88h55m52.373165023s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.419244565 (88h55m52.378342128s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422170753 (88h55m52.381267992s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422278689 (88h55m52.381375928s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.424819723 (88h55m52.383916963s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.433066314 (88h55m52.392163553s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440006888 (88h55m52.399104123s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440597254 (88h55m52.399694497s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576759325 (88h55m52.535856562s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576799803 (88h55m52.535897049s) [seg_pos={0 0}, upload=92689]: Segment reached optimal threshold of 14 pieces. Aug 12 10:21:30.577199112 (88h55m52.536296358s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF Aug 12 10:21:30.577396746 (88h55m52.536493991s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection Aug 12 10:21:30.577512417 (88h55m52.536609663s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection Aug 12 10:21:30.577591491 (88h55m52.536688735s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection Aug 12 10:21:30.577602944 (88h55m52.536700183s) [seg_pos={0 0}, upload=92689]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:21:30.577690553 (88h55m52.536787802s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:21:30.577695808 (88h55m52.536793053s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:21:30.728400515 (88h55m52.687497761s) [upload=92689]: Done uploading segments... Aug 12 10:21:30.728422317 (88h55m52.687519556s) [upload=92689]: Upload finished. err: <nil> Duration: 2.753290839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X........X.X....X....................X.........] duration: 837.777614ms FAIL (2025-08-12 10:21:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after b04d74c32afc5b796dcfcaa2ce5d2a2bdd06030ba90a74cba15ac4527e18f59b != before 6821019dd5026fdd8c04e3f9b2218da1fcf312f446cd22f0ed9a51ca8f10a87e ======LOGS====== Aug 12 10:15:46.383444258 (88h50m8.342541512s) [upload=92591]: Starting upload Aug 12 10:15:46.383595677 (88h50m8.342692914s) [upload=92591]: Done starting upload Aug 12 10:15:46.383694859 (88h50m8.342792094s) [upload=92591]: Uploading segments... Aug 12 10:15:46.383771346 (88h50m8.342868602s) [upload=92591]: Got next segment. Inline: true Aug 12 10:15:46.383779875 (88h50m8.342877127s) [upload=92591]: Waiting for error group managing segments... Aug 12 10:15:46.383855643 (88h50m8.342952879s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:15:46.383861575 (88h50m8.342958821s) [upload=92591]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 10:15:46.383865558 (88h50m8.342962803s) [upload=92591]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:15:46.530693795 (88h50m8.48979104s) [upload=92591]: Done uploading segments... Aug 12 10:15:46.530712839 (88h50m8.489810076s) [upload=92591]: Upload finished. err: <nil> Duration:* 837.808863ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 8 out of 60 is failed (threshold=3) [.XX...............X.X....X....X.....X......................X] duration: 1.742155733s FAIL (2025-08-12 10:21:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 10:21:29.470300001 (88h55m51.429397271s) [upload=92689]: Starting upload Aug 12 10:21:29.470392837 (88h55m51.429490091s) [upload=92689]: Done starting upload Aug 12 10:21:29.470534721 (88h55m51.429631959s) [upload=92689]: Uploading segments... Aug 12 10:21:29.470752297 (88h55m51.429849543s) [upload=92689]: Got next segment. Inline: false Aug 12 10:21:29.470844191 (88h55m51.429941445s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:21:29.470851531 (88h55m51.429948782s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:21:29.666044897 (88h55m51.625142157s) [seg_pos={0 0}, upload=92689]: Begin upload segment... Aug 12 10:21:29.666115543 (88h55m51.625212797s) [seg_pos={0 0}, upload=92689]: Done begin upload segment. Aug 12 10:21:29.666156188 (88h55m51.625253438s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666192345 (88h55m51.6252896s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666725092 (88h55m51.62582234s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.666756300 (88h55m51.625853556s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667160276 (88h55m51.62625753s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667281837 (88h55m51.626379116s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667734041 (88h55m51.626831295s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.667769573 (88h55m51.626866843s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668099891 (88h55m51.627197138s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668134433 (88h55m51.627231688s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668486454 (88h55m51.627583693s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.668801992 (88h55m51.627899248s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669253122 (88h55m51.62835038s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.669622660 (88h55m51.628719916s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670042402 (88h55m51.629139657s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.670090847 (88h55m51.629188107s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.674119520 (88h55m51.63321676s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:29.676843000 (88h55m51.635940243s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Uploading piece... Aug 12 10:21:30.239789079 (88h55m52.198886316s) [upload=92689]: Next returned nil segment Aug 12 10:21:30.239810682 (88h55m52.198907927s) [upload=92689]: Waiting for error group managing segments... Aug 12 10:21:30.380586554 (88h55m52.339683789s) [noise=true , address=77.90.31.10:4526 , piece_id=7VTWSEGHARWIHGO6RTJUBE26PYHBCGH22XCVBLZYBQKZJTVS2TPQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.382885137 (88h55m52.341982385s) [noise=true , address=77.90.31.13:4636 , piece_id=R3ZY3HKXYWOTAXYETYRA6XXRYHBQ4ENXWSXSS4VELKCUY3UUFO2Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.394814430 (88h55m52.353911664s) [noise=true , address=104.36.82.13:4192 , piece_id=4PL4CBJUJPMF2S2FNF5IS54YUDUSAG5UBIG2EKABOK4SKNWNH34Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.404701306 (88h55m52.363798551s) [noise=true , address=104.36.82.36:4619 , piece_id=7NJUCAUXLMYA55K23OBJ4JWRPJYLW4RRJTJHEGJLUFS5T4ZTAHBA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.405307705 (88h55m52.36440495s) [noise=true , address=104.36.82.23:4462 , piece_id=E3MSDMZVAHHPXG52XAIBNMVBXXGLIJO45PLKPZ3QIWKU5ILRD45A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.414067774 (88h55m52.373165023s) [noise=true , address=104.36.82.47:4531 , piece_id=SBG7TTKKALRNJWW2M3FNTVY2HWZWO335D2RRI32WSGLJFLJKZWCQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.419244565 (88h55m52.378342128s) [noise=true , address=104.36.82.34:4575 , piece_id=OJXJGYF7CX6TAJLDU2OC7EF6VE2DYD2RM5QBXUANHE6NWAIC4RUA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422170753 (88h55m52.381267992s) [noise=true , address=104.36.82.62:4424 , piece_id=GCSINFQHNNF7SQ4OEUDZ44SGTE4R77PDFVEGQA6CRRLJ5RCR62JQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.422278689 (88h55m52.381375928s) [noise=true , address=104.36.82.61:4375 , piece_id=GMHSEOPH7ZVAFIZ36EDH3PXXRZUNFUAUBZWI6NPAMFCBTWGV4V4Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.424819723 (88h55m52.383916963s) [noise=true , address=104.36.82.59:4329 , piece_id=AF7I3BGW3TLCZPAC3H3OAULSK3F55SM233CNREXO7JH57JBIJXYA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.433066314 (88h55m52.392163553s) [noise=true , address=104.36.82.60:4337 , piece_id=FKWYXSHYSG2TC4UIRWU2GS6BKRJ4ZV37GX3CWIPIJRW2LYG6BKDQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440006888 (88h55m52.399104123s) [noise=true , address=79.127.219.38:4006 , piece_id=DAYUVXYKWVFAHPCYCWBKSPWHJEEO6Z7OT7EY3DTDNZYLCHR3363Q, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.440597254 (88h55m52.399694497s) [noise=true , address=104.36.82.44:4900 , piece_id=UDMUXFOQREDKC56Z6YTDWQCNMJE2DUGG4S7ABATRLDQAKWRZBHOA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576759325 (88h55m52.535856562s) [noise=true , address=79.127.220.101:4066 , piece_id=A7TDKPLEDGVMKJX6NTYK6YKK7RRTZ4UFQOGLFVPGOQV75SJTF2PA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: <nil> Aug 12 10:21:30.576799803 (88h55m52.535897049s) [seg_pos={0 0}, upload=92689]: Segment reached optimal threshold of 14 pieces. Aug 12 10:21:30.577199112 (88h55m52.536296358s) [noise=true , address=79.127.201.215:4350 , piece_id=6JGLYTSARLFEWDGANC2PMX5GFXCZ25D4ARWSAEMEZEYBMZNXV6EQ, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF Aug 12 10:21:30.577396746 (88h55m52.536493991s) [noise=true , address=64.49.13.170:4724 , piece_id=GRXIPE6SX3YNLQNLHDZJYYUHSFTEWSWRXRO5K2RAPAUO5WJ62QKA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46838->64.49.13.170:4724: use of closed network connection Aug 12 10:21:30.577512417 (88h55m52.536609663s) [noise=true , address=66.23.193.175:4558 , piece_id=3X7GSXZSCICQ7M7QKTVECEZRE526T2ECXHCX2RWDNI4CNXEEJW3A, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57980->66.23.193.175:4558: use of closed network connection Aug 12 10:21:30.577591491 (88h55m52.536688735s) [noise=true , address=64.49.13.26:4946 , piece_id=ZEB4YFFFZU754IMCY7SICU2HYGUCVTVOFH6AYQ2KZWEYISAB7RNA, seg_pos={0 0}, upload=92689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55486->64.49.13.26:4946: use of closed network connection Aug 12 10:21:30.577602944 (88h55m52.536700183s) [seg_pos={0 0}, upload=92689]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 10:21:30.577690553 (88h55m52.536787802s) [upload=92689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 10:21:30.577695808 (88h55m52.536793053s) [upload=92689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 10:21:30.728400515 (88h55m52.687497761s) [upload=92689]: Done uploading segments... Aug 12 10:21:30.728422317 (88h55m52.687519556s) [upload=92689]: Upload finished. err: <nil> Duration: 1.742213196s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..XX...............X.X....X....X.....X......................] duration: 2.844433217s FAIL (2025-08-12 10:21:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 10:05:06.981719033 (88h39m28.940816283s) [upload=92407]: Starting upload Aug 12 10:05:06.981830183 (88h39m28.940927437s) [upload=92407]: Done starting upload Aug 12 10:05:06.982007924 (88h39m28.941105182s) [upload=92407]: Uploading segments... Aug 12 10:05:06.982406326 (88h39m28.941503566s) [upload=92407]: Got next segment. Inline: false Aug 12 10:05:06.982490150 (88h39m28.94158741s) [upload=92407]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 10:05:06.982498268 (88h39m28.941595516s) [upload=92407]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 10:05:07.074453109 (88h39m29.033550358s) [upload=92407]: Next segment err: metaclient: Too Many Requests Aug 12 10:05:07.074477471 (88h39m29.03357472s) [upload=92407]: Done uploading segments... Aug 12 10:05:07.074568738 (88h39m29.033665996s) [upload=92407]: Upload finished. err: metaclient: Too Many Requests Duration: 2.84446393s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)