Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.......XX...................................X.........] duration:
831.849163ms
FAIL (2025-08-14 06:33:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 831.879737ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...............................X....] duration:
2.482039035s
FAIL (2025-08-14 06:33:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 06:31:16.243818011 (133h5m38.20291526s) [upload=138658]: Starting upload Aug 14 06:31:16.244019502 (133h5m38.203116758s) [upload=138658]: Done starting upload Aug 14 06:31:16.244193470 (133h5m38.203290722s) [upload=138658]: Uploading segments... Aug 14 06:31:16.244466447 (133h5m38.203563684s) [upload=138658]: Got next segment. Inline: false Aug 14 06:31:16.244575103 (133h5m38.203672341s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:31:16.244582061 (133h5m38.203679299s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 06:31:16.333455788 (133h5m38.292553047s) [upload=138658]: Next segment err: metaclient: Too Many Requests Aug 14 06:31:16.333483890 (133h5m38.292581148s) [upload=138658]: Done uploading segments... Aug 14 06:31:16.333522929 (133h5m38.292620187s) [upload=138658]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.48207841s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...............................X...] duration:
2.444951328s
FAIL (2025-08-14 06:32:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 06:31:16.243818011 (133h5m38.20291526s) [upload=138658]: Starting upload Aug 14 06:31:16.244019502 (133h5m38.203116758s) [upload=138658]: Done starting upload Aug 14 06:31:16.244193470 (133h5m38.203290722s) [upload=138658]: Uploading segments... Aug 14 06:31:16.244466447 (133h5m38.203563684s) [upload=138658]: Got next segment. Inline: false Aug 14 06:31:16.244575103 (133h5m38.203672341s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:31:16.244582061 (133h5m38.203679299s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 06:31:16.333455788 (133h5m38.292553047s) [upload=138658]: Next segment err: metaclient: Too Many Requests Aug 14 06:31:16.333483890 (133h5m38.292581148s) [upload=138658]: Done uploading segments... Aug 14 06:31:16.333522929 (133h5m38.292620187s) [upload=138658]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.444988738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.......XX...................................X........] duration:
857.689494ms
FAIL (2025-08-14 06:32:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 857.747293ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...............................X..] duration:
2.455262259s
FAIL (2025-08-14 06:32:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 06:31:16.243818011 (133h5m38.20291526s) [upload=138658]: Starting upload Aug 14 06:31:16.244019502 (133h5m38.203116758s) [upload=138658]: Done starting upload Aug 14 06:31:16.244193470 (133h5m38.203290722s) [upload=138658]: Uploading segments... Aug 14 06:31:16.244466447 (133h5m38.203563684s) [upload=138658]: Got next segment. Inline: false Aug 14 06:31:16.244575103 (133h5m38.203672341s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:31:16.244582061 (133h5m38.203679299s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 06:31:16.333455788 (133h5m38.292553047s) [upload=138658]: Next segment err: metaclient: Too Many Requests Aug 14 06:31:16.333483890 (133h5m38.292581148s) [upload=138658]: Done uploading segments... Aug 14 06:31:16.333522929 (133h5m38.292620187s) [upload=138658]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.455298006s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...............................X.] duration:
2.571729511s
FAIL (2025-08-14 06:31:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 06:31:16.243818011 (133h5m38.20291526s) [upload=138658]: Starting upload Aug 14 06:31:16.244019502 (133h5m38.203116758s) [upload=138658]: Done starting upload Aug 14 06:31:16.244193470 (133h5m38.203290722s) [upload=138658]: Uploading segments... Aug 14 06:31:16.244466447 (133h5m38.203563684s) [upload=138658]: Got next segment. Inline: false Aug 14 06:31:16.244575103 (133h5m38.203672341s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:31:16.244582061 (133h5m38.203679299s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 06:31:16.333455788 (133h5m38.292553047s) [upload=138658]: Next segment err: metaclient: Too Many Requests Aug 14 06:31:16.333483890 (133h5m38.292581148s) [upload=138658]: Done uploading segments... Aug 14 06:31:16.333522929 (133h5m38.292620187s) [upload=138658]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.571769362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...............................X] duration:
360.325854ms
FAIL (2025-08-14 06:31:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 06:31:16.243818011 (133h5m38.20291526s) [upload=138658]: Starting upload Aug 14 06:31:16.244019502 (133h5m38.203116758s) [upload=138658]: Done starting upload Aug 14 06:31:16.244193470 (133h5m38.203290722s) [upload=138658]: Uploading segments... Aug 14 06:31:16.244466447 (133h5m38.203563684s) [upload=138658]: Got next segment. Inline: false Aug 14 06:31:16.244575103 (133h5m38.203672341s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:31:16.244582061 (133h5m38.203679299s) [upload=138658]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 06:31:16.333455788 (133h5m38.292553047s) [upload=138658]: Next segment err: metaclient: Too Many Requests Aug 14 06:31:16.333483890 (133h5m38.292581148s) [upload=138658]: Done uploading segments... Aug 14 06:31:16.333522929 (133h5m38.292620187s) [upload=138658]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.352819ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.......XX...................................X.......] duration:
815.849245ms
FAIL (2025-08-14 06:31:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 815.902057ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.......XX...................................X......] duration:
822.648897ms
FAIL (2025-08-14 06:30:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 822.681263ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.328773195s
FAIL (2025-08-14 06:30:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.328808345s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.404262792s
FAIL (2025-08-14 06:30:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.404334442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.......XX...................................X.....] duration:
854.647581ms
FAIL (2025-08-14 06:29:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 854.738404ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.......XX...................................X....] duration:
809.31141ms
FAIL (2025-08-14 06:29:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 809.34803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.393073594s
FAIL (2025-08-14 06:29:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.393204296s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.......XX...................................X...] duration:
835.663045ms
FAIL (2025-08-14 06:28:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 835.715875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.329227173s
FAIL (2025-08-14 06:28:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.329261564s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.......XX...................................X..] duration:
854.44185ms
FAIL (2025-08-14 06:27:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 854.480416ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.......XX...................................X.] duration:
885.734436ms
FAIL (2025-08-14 06:27:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 885.835013ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.379940567s
FAIL (2025-08-14 06:27:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.379974566s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.......XX...................................X] duration:
763.493072ms
FAIL (2025-08-14 06:26:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 06:26:36.101234104 (133h0m58.060331351s) [upload=138574]: Starting upload Aug 14 06:26:36.101321622 (133h0m58.060418862s) [upload=138574]: Done starting upload Aug 14 06:26:36.101474727 (133h0m58.060571966s) [upload=138574]: Uploading segments... Aug 14 06:26:36.101553146 (133h0m58.060650393s) [upload=138574]: Got next segment. Inline: true Aug 14 06:26:36.101559388 (133h0m58.060656634s) [upload=138574]: Waiting for error group managing segments... Aug 14 06:26:36.101623538 (133h0m58.060720785s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 06:26:36.101629296 (133h0m58.060726543s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 06:26:36.101633716 (133h0m58.060730964s) [upload=138574]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 06:26:36.380064609 (133h0m58.339161849s) [upload=138574]: Done uploading segments... Aug 14 06:26:36.380110361 (133h0m58.339207612s) [upload=138574]: Upload finished. err: <nil>
Duration: 763.529001ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.390977971s
FAIL (2025-08-14 06:26:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.391005625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.289389603s
FAIL (2025-08-14 06:25:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.289419397s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.......XX...................................] duration:
823.453741ms
FAIL (2025-08-14 06:25:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.48492ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.......XX..................................] duration:
832.914185ms
FAIL (2025-08-14 06:25:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.950776ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.264007299s
FAIL (2025-08-14 06:24:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.264042757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.......XX.................................] duration:
1.038743225s
FAIL (2025-08-14 06:24:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.038770844s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...................................X.......................] duration:
2.353564723s
FAIL (2025-08-14 06:23:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.353680328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.......XX................................] duration:
814.295025ms
FAIL (2025-08-14 06:23:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 814.325116ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.......XX...............................] duration:
837.432933ms
FAIL (2025-08-14 06:22:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.525407ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...................................X......................] duration:
2.404716687s
FAIL (2025-08-14 06:22:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.404866564s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...................................X.....................] duration:
2.337813562s
FAIL (2025-08-14 06:22:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.337846838s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.......XX..............................] duration:
926.853647ms
FAIL (2025-08-14 06:22:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 926.892406ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...................................X....................] duration:
2.43554953s
FAIL (2025-08-14 06:21:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.435587761s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X....................X.......XX.............................] duration:
827.056231ms
FAIL (2025-08-14 06:21:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.085025ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...................................X...................] duration:
2.37434458s
FAIL (2025-08-14 06:20:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.37441103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X....................X.......XX............................] duration:
869.209199ms
FAIL (2025-08-14 06:20:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.25044ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...................................X..................] duration:
2.584022522s
FAIL (2025-08-14 06:19:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.584058505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.X....................X.......XX...........................] duration:
881.962859ms
FAIL (2025-08-14 06:19:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 881.99958ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.X....................X.......XX..........................] duration:
825.733124ms
FAIL (2025-08-14 06:18:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 825.781308ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...................................X.................] duration:
2.333515523s
FAIL (2025-08-14 06:18:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.333548308s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.X....................X.......XX.........................] duration:
991.855858ms
FAIL (2025-08-14 06:18:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 991.912534ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...................................X................] duration:
2.458929807s
FAIL (2025-08-14 06:17:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.458970229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.X....................X.......XX........................] duration:
864.63055ms
FAIL (2025-08-14 06:17:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.666984ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...................................X...............] duration:
2.344039179s
FAIL (2025-08-14 06:16:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.344072848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X...................................X..............] duration:
2.336764528s
FAIL (2025-08-14 06:16:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.336793634s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.X....................X.......XX.......................] duration:
824.548037ms
FAIL (2025-08-14 06:16:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.594926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X...................................X.............] duration:
2.380416311s
FAIL (2025-08-14 06:15:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.380524326s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..........X...................................X............] duration:
2.545237833s
FAIL (2025-08-14 06:15:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.545274581s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X.X....................X.......XX......................] duration:
880.441944ms
FAIL (2025-08-14 06:15:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.48056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..........X...................................X...........] duration:
2.612676428s
FAIL (2025-08-14 06:14:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.612719498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|