Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.......X..X............X....................X..........] duration:
864.664078ms
FAIL (2025-08-18 00:03:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 864.700505ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X....X.............................................X..] duration:
2.849968615s
FAIL (2025-08-18 00:03:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:02:06.557639308 (222h36m28.516736548s) [upload=231718]: Starting upload Aug 18 00:02:06.557719562 (222h36m28.516816808s) [upload=231718]: Done starting upload Aug 18 00:02:06.557979630 (222h36m28.517076867s) [upload=231718]: Uploading segments... Aug 18 00:02:06.558331555 (222h36m28.517428809s) [upload=231718]: Got next segment. Inline: false Aug 18 00:02:06.558402805 (222h36m28.51750005s) [upload=231718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:02:06.558411010 (222h36m28.517508255s) [upload=231718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 00:02:06.650092857 (222h36m28.609190106s) [upload=231718]: Next segment err: metaclient: Too Many Requests Aug 18 00:02:06.650133365 (222h36m28.60923061s) [upload=231718]: Done uploading segments... Aug 18 00:02:06.650152059 (222h36m28.609249291s) [upload=231718]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.850013003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X....X.............................................X.] duration:
2.750371419s
FAIL (2025-08-18 00:03:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:02:06.557639308 (222h36m28.516736548s) [upload=231718]: Starting upload Aug 18 00:02:06.557719562 (222h36m28.516816808s) [upload=231718]: Done starting upload Aug 18 00:02:06.557979630 (222h36m28.517076867s) [upload=231718]: Uploading segments... Aug 18 00:02:06.558331555 (222h36m28.517428809s) [upload=231718]: Got next segment. Inline: false Aug 18 00:02:06.558402805 (222h36m28.51750005s) [upload=231718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:02:06.558411010 (222h36m28.517508255s) [upload=231718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 00:02:06.650092857 (222h36m28.609190106s) [upload=231718]: Next segment err: metaclient: Too Many Requests Aug 18 00:02:06.650133365 (222h36m28.60923061s) [upload=231718]: Done uploading segments... Aug 18 00:02:06.650152059 (222h36m28.609249291s) [upload=231718]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.750409555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X.......X..X............X....................X.........] duration:
1.022756372s
FAIL (2025-08-18 00:03:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 1.02279053s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X.......X..X............X....................X........] duration:
995.179171ms
FAIL (2025-08-18 00:02:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 995.213256ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.......X..X............X....................X.......] duration:
863.712291ms
FAIL (2025-08-18 00:02:08 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 863.755881ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X....X.............................................X] duration:
363.936822ms
FAIL (2025-08-18 00:02:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:02:06.557639308 (222h36m28.516736548s) [upload=231718]: Starting upload Aug 18 00:02:06.557719562 (222h36m28.516816808s) [upload=231718]: Done starting upload Aug 18 00:02:06.557979630 (222h36m28.517076867s) [upload=231718]: Uploading segments... Aug 18 00:02:06.558331555 (222h36m28.517428809s) [upload=231718]: Got next segment. Inline: false Aug 18 00:02:06.558402805 (222h36m28.51750005s) [upload=231718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:02:06.558411010 (222h36m28.517508255s) [upload=231718]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 00:02:06.650092857 (222h36m28.609190106s) [upload=231718]: Next segment err: metaclient: Too Many Requests Aug 18 00:02:06.650133365 (222h36m28.60923061s) [upload=231718]: Done uploading segments... Aug 18 00:02:06.650152059 (222h36m28.609249291s) [upload=231718]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.021346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X....X.............................................] duration:
2.675374941s
FAIL (2025-08-18 00:01:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.675404145s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.......X..X............X....................X......] duration:
969.663417ms
FAIL (2025-08-18 00:01:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 969.696203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.......X..X............X....................X.....] duration:
1.146173593s
FAIL (2025-08-18 00:00:30 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 1.146221026s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X....X............................................] duration:
2.763902883s
FAIL (2025-08-18 00:00:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.763940388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.......X..X............X....................X....] duration:
870.284815ms
FAIL (2025-08-18 00:00:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 870.338601ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X....X...........................................] duration:
2.700264967s
FAIL (2025-08-17 23:59:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.700298045s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.......X..X............X....................X...] duration:
884.475896ms
FAIL (2025-08-17 23:59:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 884.513922ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X....X..........................................] duration:
2.720068995s
FAIL (2025-08-17 23:59:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.720105643s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X....X.........................................] duration:
3.003502675s
FAIL (2025-08-17 23:59:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 3.003542527s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.......X..X............X....................X..] duration:
886.91599ms
FAIL (2025-08-17 23:58:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 886.943196ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X....X........................................] duration:
2.659896174s
FAIL (2025-08-17 23:58:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.660031925s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X.......X..X............X....................X.] duration:
877.277784ms
FAIL (2025-08-17 23:57:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 877.314341ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X....X.......................................] duration:
2.808088223s
FAIL (2025-08-17 23:57:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.808117281s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X.......X..X............X....................X] duration:
641.264174ms
FAIL (2025-08-17 23:56:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 23:56:48.448616145 (222h31m10.407713391s) [upload=231626]: Starting upload Aug 17 23:56:48.448665884 (222h31m10.407763115s) [upload=231626]: Done starting upload Aug 17 23:56:48.448724668 (222h31m10.407821914s) [upload=231626]: Uploading segments... Aug 17 23:56:48.448823183 (222h31m10.40792044s) [upload=231626]: Got next segment. Inline: true Aug 17 23:56:48.448830657 (222h31m10.407927916s) [upload=231626]: Waiting for error group managing segments... Aug 17 23:56:48.448904011 (222h31m10.408001259s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 23:56:48.448912596 (222h31m10.408009851s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 23:56:48.448934024 (222h31m10.408031273s) [upload=231626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 23:56:48.618888219 (222h31m10.577985464s) [upload=231626]: Done uploading segments... Aug 17 23:56:48.618911019 (222h31m10.578008264s) [upload=231626]: Upload finished. err: <nil>
Duration: 641.391883ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X....X......................................] duration:
2.557970592s
FAIL (2025-08-17 23:56:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.558002667s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.......X..X............X....................] duration:
1.025375294s
FAIL (2025-08-17 23:55:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 1.025406353s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X.......X..X............X...................] duration:
846.153486ms
FAIL (2025-08-17 23:55:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 846.188009ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X....X.....................................] duration:
2.651640449s
FAIL (2025-08-17 23:54:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.65167432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X.......X..X............X..................] duration:
855.610557ms
FAIL (2025-08-17 23:54:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 855.706314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X....X....................................] duration:
2.885819343s
FAIL (2025-08-17 23:54:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.885851984s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.......X..X............X.................] duration:
909.073951ms
FAIL (2025-08-17 23:53:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 909.109082ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X....X...................................] duration:
3.046889835s
FAIL (2025-08-17 23:53:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 3.046918874s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X.......X..X............X................] duration:
852.234278ms
FAIL (2025-08-17 23:52:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 852.261909ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X....X..................................] duration:
2.908578981s
FAIL (2025-08-17 23:52:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.908666529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....X.................................] duration:
2.669031984s
FAIL (2025-08-17 23:52:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.669063361s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X.......X..X............X...............] duration:
864.444859ms
FAIL (2025-08-17 23:51:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 864.482497ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X....X................................] duration:
2.871052753s
FAIL (2025-08-17 23:51:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.871085577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.......X..X............X..............] duration:
827.162706ms
FAIL (2025-08-17 23:51:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 827.197309ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X....X...............................] duration:
3.205525623s
FAIL (2025-08-17 23:51:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 3.205553234s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X.......X..X............X.............] duration:
864.532257ms
FAIL (2025-08-17 23:50:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 864.571725ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X....X..............................] duration:
2.646540479s
FAIL (2025-08-17 23:50:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.646574366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X....X.............................] duration:
3.264762644s
FAIL (2025-08-17 23:49:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 3.264793283s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.......X..X............X............] duration:
835.566835ms
FAIL (2025-08-17 23:49:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 835.605472ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X....X............................] duration:
2.564584382s
FAIL (2025-08-17 23:48:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.564616148s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X.......X..X............X...........] duration:
922.093821ms
FAIL (2025-08-17 23:48:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 922.153518ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.......X..X............X..........] duration:
1.04642063s
FAIL (2025-08-17 23:48:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 1.046451473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.......X..X............X.........] duration:
859.106707ms
FAIL (2025-08-17 23:48:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 859.146311ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X....X...........................] duration:
3.069681218s
FAIL (2025-08-17 23:47:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 3.069743383s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.......X..X............X........] duration:
887.220173ms
FAIL (2025-08-17 23:47:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 887.261978ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X....X..........................] duration:
2.809861139s
FAIL (2025-08-17 23:47:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 2.809893613s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................X.......X..X............X.......] duration:
919.438973ms
FAIL (2025-08-17 23:46:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 919.475934ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X....X.........................] duration:
3.08071787s
FAIL (2025-08-17 23:46:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:26:22.212328695 (222h0m44.171425946s) [upload=231089]: Starting upload
Aug 17 23:26:22.212409776 (222h0m44.171507035s) [upload=231089]: Done starting upload
Aug 17 23:26:22.212786641 (222h0m44.171883894s) [upload=231089]: Uploading segments...
Aug 17 23:26:22.213202225 (222h0m44.172299481s) [upload=231089]: Got next segment. Inline: false
Aug 17 23:26:22.213242948 (222h0m44.172340195s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:26:22.213249271 (222h0m44.17234652s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:26:22.431968989 (222h0m44.391066233s) [seg_pos={0 0}, upload=231089]: Begin upload segment...
Aug 17 23:26:22.432032435 (222h0m44.391129667s) [seg_pos={0 0}, upload=231089]: Done begin upload segment.
Aug 17 23:26:22.432095061 (222h0m44.391192292s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432103374 (222h0m44.391200623s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432158911 (222h0m44.39125616s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432483488 (222h0m44.39158072s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432606132 (222h0m44.391703393s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432960919 (222h0m44.392058168s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.432979861 (222h0m44.392077114s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433294297 (222h0m44.392391554s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433338056 (222h0m44.392435301s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433586135 (222h0m44.392683382s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433684256 (222h0m44.392781489s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.433999134 (222h0m44.393096382s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.434268330 (222h0m44.393365562s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435061629 (222h0m44.394158878s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435500392 (222h0m44.394597642s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.435953586 (222h0m44.395050838s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436331912 (222h0m44.39542916s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.436845044 (222h0m44.3959423s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Uploading piece...
Aug 17 23:26:22.537179192 (222h0m44.496276437s) [noise=true , address=45.91.116.12:4256 , piece_id=2XPGFGLCG2PAIQNLZTBC4ROKNAEASZWTQ7KYQ7V42RRWI2J5IHRQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: ecclient: upload failed (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME, address:45.91.116.12:4256): protocol: rpc: dial tcp 45.91.116.12:4256: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:26:23.019128479 (222h0m44.978225734s) [upload=231089]: Next returned nil segment
Aug 17 23:26:23.019152632 (222h0m44.978249888s) [upload=231089]: Waiting for error group managing segments...
Aug 17 23:26:23.169874622 (222h0m45.128971874s) [noise=true , address=104.36.82.38:4714 , piece_id=PA3YZZVCCM6RXJN3PSDZDAMKRCXMJYOIE5RSAUWTY4BWWPPLHNYQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.181631068 (222h0m45.140728316s) [noise=true , address=104.36.82.9:4014 , piece_id=PYYX5TQ5BZM6SOC5MS3G43WKWDQRCMZWVSN2OGWSMTW3WECO2WXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.182700277 (222h0m45.141797514s) [noise=true , address=104.36.82.35:4606 , piece_id=NXQAGQXNFQDP3RSM4XXPEDXPCHDH7CP5XNV25MAPWDQ3YSAENX6Q, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.204382129 (222h0m45.163479362s) [noise=true , address=104.36.82.4:4813 , piece_id=XAWSF6MOP5SPJBLRPCXDLLUGF7GJURVF6V75YJI3BZSTGRM6L6WQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.208176600 (222h0m45.167273833s) [noise=true , address=104.36.82.14:4231 , piece_id=6NHNNVB6EAEYW4JA35EW5G4MDUM66MDDUQGBYKMC4VWOHGAM2KFA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.217608274 (222h0m45.176705512s) [noise=true , address=104.36.82.23:4455 , piece_id=3B72LRZDDBMTHZZGPI2VZV654XIMHKAKGODAP3S4Q4PDC6URO2BQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.238354923 (222h0m45.19745217s) [noise=true , address=104.36.82.45:4908 , piece_id=MGFF5SCAYKM4LLBGESA3PTDCN7DMUG7AAB76YG66F4G2PSQEMUDQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.242017661 (222h0m45.201114902s) [noise=true , address=77.90.31.10:4531 , piece_id=AOMIDZS4ESCCZDX7IHN6TVRNGET6U5WJXGYNJWZPBRSAVRP537UQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.253608189 (222h0m45.212705426s) [noise=true , address=104.36.82.21:4490 , piece_id=YM6M6FLPSEITJKWS7PCHJZ4MP5BHNCZ2J3D5VBXNJTRBWL4PY6XA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.274696675 (222h0m45.233793913s) [noise=true , address=77.90.31.11:4566 , piece_id=TTLTJUDZCWC2PUAXYQHL7CZASTBI4AYL5UFYVH7HT6PLPJH2R2MQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.285411023 (222h0m45.244508268s) [noise=true , address=77.90.31.18:4832 , piece_id=QJN3JXOC3EFA37ZVGOSUML36OIHJWMX6HDXQKYLFCGT6LDVBT7GQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.304048536 (222h0m45.263145781s) [noise=true , address=104.36.82.44:4878 , piece_id=7MUGQJCID5EUR5VZQU3T3WOWBAJ3AQS4UTH4W765A65YL52JPWXA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.336220769 (222h0m45.295318001s) [noise=true , address=77.90.31.13:4636 , piece_id=JHAJFJFJ54LTFEKHWIPFOLRVVPBQ4NX5IV4UC2R6L2OJU3P3TMQQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360148302 (222h0m45.31924554s) [noise=true , address=45.91.116.7:4019 , piece_id=EZ5TFI3FYULISHBCTPLL6VZ57QDOSRXJTJUB6OU2ELE4W5TSRK6A, seg_pos={0 0}, upload=231089]: Done uploading piece. err: <nil>
Aug 17 23:26:23.360182395 (222h0m45.31927964s) [seg_pos={0 0}, upload=231089]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:26:23.360391209 (222h0m45.319488448s) [noise=true , address=104.36.82.17:4363 , piece_id=TRHCE5KSZRPEKWE4MRM3CCOKDUMYKRKTBUTV6ZTZTI54CTX4OWNA, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1utxkAShN2ZyJH3ZXgAES2Ue1NYa1JGNkcJyzUGe4aRY3WL7Lg): protocol: expected piece hash; context canceled; EOF
Aug 17 23:26:23.360416035 (222h0m45.319513281s) [noise=true , address=104.36.82.44:4874 , piece_id=HSM7LEDME5A2VGZPCOC65KLDFWEUFJV2IPZCG766OPRKONB76VBQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38824->104.36.82.44:4874: use of closed network connection
Aug 17 23:26:23.360575097 (222h0m45.319672343s) [noise=true , address=104.36.82.58:4270 , piece_id=Y2EVLDXNAC3FEKWFYQ4M2HSSMXJ5N2YRWUXQHAU4E5DDGEWE4GXQ, seg_pos={0 0}, upload=231089]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81): protocol: write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection; write tcp 139.59.144.22:58736->104.36.82.58:4270: use of closed network connection
Aug 17 23:26:23.360601784 (222h0m45.31969903s) [seg_pos={0 0}, upload=231089]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:26:23.360732713 (222h0m45.319829966s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:26:23.360740356 (222h0m45.319837602s) [upload=231089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:26:23.597140724 (222h0m45.556237992s) [upload=231089]: Done uploading segments...
Aug 17 23:26:23.597161965 (222h0m45.556259199s) [upload=231089]: Upload finished. err: <nil>
Duration: 3.080748891s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................X.......X..X............X......] duration:
1.025732093s
FAIL (2025-08-17 23:46:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 23:41:17.836399468 (222h15m39.795496715s) [upload=231353]: Starting upload
Aug 17 23:41:17.836487796 (222h15m39.795585102s) [upload=231353]: Done starting upload
Aug 17 23:41:17.836613072 (222h15m39.795710306s) [upload=231353]: Uploading segments...
Aug 17 23:41:17.836712127 (222h15m39.795809383s) [upload=231353]: Got next segment. Inline: true
Aug 17 23:41:17.836720979 (222h15m39.79581824s) [upload=231353]: Waiting for error group managing segments...
Aug 17 23:41:17.836936960 (222h15m39.796034215s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:41:17.836945441 (222h15m39.796042695s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 23:41:17.836950200 (222h15m39.796047447s) [upload=231353]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:41:18.013125334 (222h15m39.972222591s) [upload=231353]: Done uploading segments...
Aug 17 23:41:18.013151071 (222h15m39.972248326s) [upload=231353]: Upload finished. err: <nil>
Duration: 1.025811034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|