Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X.....X............................X....] duration:
2.414501002s
FAIL (2025-08-11 06:09:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 06:05:40.848305184 (60h40m2.807402433s) [upload=63178]: Starting upload
Aug 11 06:05:40.848393987 (60h40m2.807491237s) [upload=63178]: Done starting upload
Aug 11 06:05:40.848531207 (60h40m2.807628453s) [upload=63178]: Uploading segments...
Aug 11 06:05:40.848721773 (60h40m2.807819018s) [upload=63178]: Got next segment. Inline: false
Aug 11 06:05:40.848766001 (60h40m2.807863246s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:05:40.848771679 (60h40m2.807868928s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:05:41.043649795 (60h40m3.002747041s) [seg_pos={0 0}, upload=63178]: Begin upload segment...
Aug 11 06:05:41.043731130 (60h40m3.002828366s) [seg_pos={0 0}, upload=63178]: Done begin upload segment.
Aug 11 06:05:41.043783361 (60h40m3.002880616s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.043851154 (60h40m3.0029484s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044228165 (60h40m3.00332542s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044322621 (60h40m3.003419876s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044595279 (60h40m3.003692529s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044799191 (60h40m3.003896446s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044897525 (60h40m3.003994778s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045186600 (60h40m3.004283886s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045298181 (60h40m3.004395436s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045475570 (60h40m3.004572821s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045690458 (60h40m3.004787704s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045786012 (60h40m3.004883263s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046069419 (60h40m3.005166664s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046594708 (60h40m3.005691959s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047025347 (60h40m3.006122595s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047519298 (60h40m3.006616548s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047975290 (60h40m3.007072562s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.048413727 (60h40m3.007510973s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.579836587 (60h40m3.538933832s) [upload=63178]: Next returned nil segment
Aug 11 06:05:41.579863933 (60h40m3.538961182s) [upload=63178]: Waiting for error group managing segments...
Aug 11 06:05:41.764141685 (60h40m3.723238919s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.764337527 (60h40m3.723434765s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.775015575 (60h40m3.73411282s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777177500 (60h40m3.736274747s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777349525 (60h40m3.736446771s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.778725457 (60h40m3.737822703s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.781541857 (60h40m3.740639092s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782026425 (60h40m3.741123657s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782184884 (60h40m3.741282123s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.795492620 (60h40m3.754589871s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.803902876 (60h40m3.763000122s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.806910506 (60h40m3.766007758s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.813618969 (60h40m3.772716206s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826793679 (60h40m3.785890928s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826824631 (60h40m3.785921881s) [seg_pos={0 0}, upload=63178]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:05:41.827686129 (60h40m3.786783376s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 11 06:05:41.828112039 (60h40m3.787209288s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection
Aug 11 06:05:41.828239916 (60h40m3.787337163s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection
Aug 11 06:05:41.828382546 (60h40m3.787479798s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection
Aug 11 06:05:41.828409620 (60h40m3.787506869s) [seg_pos={0 0}, upload=63178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:05:41.828500638 (60h40m3.787597884s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:05:41.828507094 (60h40m3.787604355s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:05:41.984124547 (60h40m3.943221803s) [upload=63178]: Done uploading segments...
Aug 11 06:05:41.984150099 (60h40m3.943247351s) [upload=63178]: Upload finished. err: <nil>
Duration: 2.414532953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X....XX.....................................................] duration:
845.608908ms
FAIL (2025-08-11 06:09:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.637846ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X....XX....................................................] duration:
829.445329ms
FAIL (2025-08-11 06:09:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.482283ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.....X............................X...] duration:
2.531493071s
FAIL (2025-08-11 06:08:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 06:05:40.848305184 (60h40m2.807402433s) [upload=63178]: Starting upload
Aug 11 06:05:40.848393987 (60h40m2.807491237s) [upload=63178]: Done starting upload
Aug 11 06:05:40.848531207 (60h40m2.807628453s) [upload=63178]: Uploading segments...
Aug 11 06:05:40.848721773 (60h40m2.807819018s) [upload=63178]: Got next segment. Inline: false
Aug 11 06:05:40.848766001 (60h40m2.807863246s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:05:40.848771679 (60h40m2.807868928s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:05:41.043649795 (60h40m3.002747041s) [seg_pos={0 0}, upload=63178]: Begin upload segment...
Aug 11 06:05:41.043731130 (60h40m3.002828366s) [seg_pos={0 0}, upload=63178]: Done begin upload segment.
Aug 11 06:05:41.043783361 (60h40m3.002880616s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.043851154 (60h40m3.0029484s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044228165 (60h40m3.00332542s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044322621 (60h40m3.003419876s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044595279 (60h40m3.003692529s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044799191 (60h40m3.003896446s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044897525 (60h40m3.003994778s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045186600 (60h40m3.004283886s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045298181 (60h40m3.004395436s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045475570 (60h40m3.004572821s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045690458 (60h40m3.004787704s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045786012 (60h40m3.004883263s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046069419 (60h40m3.005166664s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046594708 (60h40m3.005691959s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047025347 (60h40m3.006122595s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047519298 (60h40m3.006616548s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047975290 (60h40m3.007072562s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.048413727 (60h40m3.007510973s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.579836587 (60h40m3.538933832s) [upload=63178]: Next returned nil segment
Aug 11 06:05:41.579863933 (60h40m3.538961182s) [upload=63178]: Waiting for error group managing segments...
Aug 11 06:05:41.764141685 (60h40m3.723238919s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.764337527 (60h40m3.723434765s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.775015575 (60h40m3.73411282s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777177500 (60h40m3.736274747s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777349525 (60h40m3.736446771s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.778725457 (60h40m3.737822703s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.781541857 (60h40m3.740639092s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782026425 (60h40m3.741123657s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782184884 (60h40m3.741282123s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.795492620 (60h40m3.754589871s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.803902876 (60h40m3.763000122s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.806910506 (60h40m3.766007758s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.813618969 (60h40m3.772716206s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826793679 (60h40m3.785890928s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826824631 (60h40m3.785921881s) [seg_pos={0 0}, upload=63178]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:05:41.827686129 (60h40m3.786783376s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 11 06:05:41.828112039 (60h40m3.787209288s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection
Aug 11 06:05:41.828239916 (60h40m3.787337163s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection
Aug 11 06:05:41.828382546 (60h40m3.787479798s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection
Aug 11 06:05:41.828409620 (60h40m3.787506869s) [seg_pos={0 0}, upload=63178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:05:41.828500638 (60h40m3.787597884s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:05:41.828507094 (60h40m3.787604355s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:05:41.984124547 (60h40m3.943221803s) [upload=63178]: Done uploading segments...
Aug 11 06:05:41.984150099 (60h40m3.943247351s) [upload=63178]: Upload finished. err: <nil>
Duration: 2.531520305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X.....X............................X..] duration:
2.296913995s
FAIL (2025-08-11 06:08:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 06:05:40.848305184 (60h40m2.807402433s) [upload=63178]: Starting upload
Aug 11 06:05:40.848393987 (60h40m2.807491237s) [upload=63178]: Done starting upload
Aug 11 06:05:40.848531207 (60h40m2.807628453s) [upload=63178]: Uploading segments...
Aug 11 06:05:40.848721773 (60h40m2.807819018s) [upload=63178]: Got next segment. Inline: false
Aug 11 06:05:40.848766001 (60h40m2.807863246s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:05:40.848771679 (60h40m2.807868928s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:05:41.043649795 (60h40m3.002747041s) [seg_pos={0 0}, upload=63178]: Begin upload segment...
Aug 11 06:05:41.043731130 (60h40m3.002828366s) [seg_pos={0 0}, upload=63178]: Done begin upload segment.
Aug 11 06:05:41.043783361 (60h40m3.002880616s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.043851154 (60h40m3.0029484s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044228165 (60h40m3.00332542s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044322621 (60h40m3.003419876s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044595279 (60h40m3.003692529s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044799191 (60h40m3.003896446s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044897525 (60h40m3.003994778s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045186600 (60h40m3.004283886s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045298181 (60h40m3.004395436s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045475570 (60h40m3.004572821s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045690458 (60h40m3.004787704s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045786012 (60h40m3.004883263s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046069419 (60h40m3.005166664s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046594708 (60h40m3.005691959s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047025347 (60h40m3.006122595s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047519298 (60h40m3.006616548s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047975290 (60h40m3.007072562s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.048413727 (60h40m3.007510973s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.579836587 (60h40m3.538933832s) [upload=63178]: Next returned nil segment
Aug 11 06:05:41.579863933 (60h40m3.538961182s) [upload=63178]: Waiting for error group managing segments...
Aug 11 06:05:41.764141685 (60h40m3.723238919s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.764337527 (60h40m3.723434765s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.775015575 (60h40m3.73411282s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777177500 (60h40m3.736274747s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777349525 (60h40m3.736446771s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.778725457 (60h40m3.737822703s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.781541857 (60h40m3.740639092s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782026425 (60h40m3.741123657s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782184884 (60h40m3.741282123s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.795492620 (60h40m3.754589871s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.803902876 (60h40m3.763000122s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.806910506 (60h40m3.766007758s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.813618969 (60h40m3.772716206s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826793679 (60h40m3.785890928s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826824631 (60h40m3.785921881s) [seg_pos={0 0}, upload=63178]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:05:41.827686129 (60h40m3.786783376s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 11 06:05:41.828112039 (60h40m3.787209288s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection
Aug 11 06:05:41.828239916 (60h40m3.787337163s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection
Aug 11 06:05:41.828382546 (60h40m3.787479798s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection
Aug 11 06:05:41.828409620 (60h40m3.787506869s) [seg_pos={0 0}, upload=63178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:05:41.828500638 (60h40m3.787597884s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:05:41.828507094 (60h40m3.787604355s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:05:41.984124547 (60h40m3.943221803s) [upload=63178]: Done uploading segments...
Aug 11 06:05:41.984150099 (60h40m3.943247351s) [upload=63178]: Upload finished. err: <nil>
Duration: 2.296943152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X....XX...................................................] duration:
846.66541ms
FAIL (2025-08-11 06:07:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.697802ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.....X............................X.] duration:
2.376093267s
FAIL (2025-08-11 06:06:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 06:05:40.848305184 (60h40m2.807402433s) [upload=63178]: Starting upload
Aug 11 06:05:40.848393987 (60h40m2.807491237s) [upload=63178]: Done starting upload
Aug 11 06:05:40.848531207 (60h40m2.807628453s) [upload=63178]: Uploading segments...
Aug 11 06:05:40.848721773 (60h40m2.807819018s) [upload=63178]: Got next segment. Inline: false
Aug 11 06:05:40.848766001 (60h40m2.807863246s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:05:40.848771679 (60h40m2.807868928s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:05:41.043649795 (60h40m3.002747041s) [seg_pos={0 0}, upload=63178]: Begin upload segment...
Aug 11 06:05:41.043731130 (60h40m3.002828366s) [seg_pos={0 0}, upload=63178]: Done begin upload segment.
Aug 11 06:05:41.043783361 (60h40m3.002880616s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.043851154 (60h40m3.0029484s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044228165 (60h40m3.00332542s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044322621 (60h40m3.003419876s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044595279 (60h40m3.003692529s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044799191 (60h40m3.003896446s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044897525 (60h40m3.003994778s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045186600 (60h40m3.004283886s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045298181 (60h40m3.004395436s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045475570 (60h40m3.004572821s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045690458 (60h40m3.004787704s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045786012 (60h40m3.004883263s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046069419 (60h40m3.005166664s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046594708 (60h40m3.005691959s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047025347 (60h40m3.006122595s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047519298 (60h40m3.006616548s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047975290 (60h40m3.007072562s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.048413727 (60h40m3.007510973s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.579836587 (60h40m3.538933832s) [upload=63178]: Next returned nil segment
Aug 11 06:05:41.579863933 (60h40m3.538961182s) [upload=63178]: Waiting for error group managing segments...
Aug 11 06:05:41.764141685 (60h40m3.723238919s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.764337527 (60h40m3.723434765s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.775015575 (60h40m3.73411282s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777177500 (60h40m3.736274747s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777349525 (60h40m3.736446771s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.778725457 (60h40m3.737822703s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.781541857 (60h40m3.740639092s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782026425 (60h40m3.741123657s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782184884 (60h40m3.741282123s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.795492620 (60h40m3.754589871s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.803902876 (60h40m3.763000122s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.806910506 (60h40m3.766007758s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.813618969 (60h40m3.772716206s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826793679 (60h40m3.785890928s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826824631 (60h40m3.785921881s) [seg_pos={0 0}, upload=63178]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:05:41.827686129 (60h40m3.786783376s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 11 06:05:41.828112039 (60h40m3.787209288s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection
Aug 11 06:05:41.828239916 (60h40m3.787337163s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection
Aug 11 06:05:41.828382546 (60h40m3.787479798s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection
Aug 11 06:05:41.828409620 (60h40m3.787506869s) [seg_pos={0 0}, upload=63178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:05:41.828500638 (60h40m3.787597884s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:05:41.828507094 (60h40m3.787604355s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:05:41.984124547 (60h40m3.943221803s) [upload=63178]: Done uploading segments...
Aug 11 06:05:41.984150099 (60h40m3.943247351s) [upload=63178]: Upload finished. err: <nil>
Duration: 2.37618907s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X....XX..................................................] duration:
819.926453ms
FAIL (2025-08-11 06:06:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.957282ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X.....X............................X] duration:
1.604150541s
FAIL (2025-08-11 06:05:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 06:05:40.848305184 (60h40m2.807402433s) [upload=63178]: Starting upload
Aug 11 06:05:40.848393987 (60h40m2.807491237s) [upload=63178]: Done starting upload
Aug 11 06:05:40.848531207 (60h40m2.807628453s) [upload=63178]: Uploading segments...
Aug 11 06:05:40.848721773 (60h40m2.807819018s) [upload=63178]: Got next segment. Inline: false
Aug 11 06:05:40.848766001 (60h40m2.807863246s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 06:05:40.848771679 (60h40m2.807868928s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 06:05:41.043649795 (60h40m3.002747041s) [seg_pos={0 0}, upload=63178]: Begin upload segment...
Aug 11 06:05:41.043731130 (60h40m3.002828366s) [seg_pos={0 0}, upload=63178]: Done begin upload segment.
Aug 11 06:05:41.043783361 (60h40m3.002880616s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.043851154 (60h40m3.0029484s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044228165 (60h40m3.00332542s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044322621 (60h40m3.003419876s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044595279 (60h40m3.003692529s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044799191 (60h40m3.003896446s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.044897525 (60h40m3.003994778s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045186600 (60h40m3.004283886s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045298181 (60h40m3.004395436s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045475570 (60h40m3.004572821s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045690458 (60h40m3.004787704s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.045786012 (60h40m3.004883263s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046069419 (60h40m3.005166664s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.046594708 (60h40m3.005691959s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047025347 (60h40m3.006122595s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047519298 (60h40m3.006616548s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.047975290 (60h40m3.007072562s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.048413727 (60h40m3.007510973s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Uploading piece...
Aug 11 06:05:41.579836587 (60h40m3.538933832s) [upload=63178]: Next returned nil segment
Aug 11 06:05:41.579863933 (60h40m3.538961182s) [upload=63178]: Waiting for error group managing segments...
Aug 11 06:05:41.764141685 (60h40m3.723238919s) [noise=true , address=45.91.116.14:4215 , piece_id=TSYWD5BLKXEEM7UUQNNLXTFKD7NJTN436F5FCNYNMAPEGQP37OJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.764337527 (60h40m3.723434765s) [noise=true , address=104.36.82.34:4564 , piece_id=VKSCQU7QYSYLWZG4OZJHRYQ6JZWAKK6FKMLHR5EJS2EAMB3ZQZZA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.775015575 (60h40m3.73411282s) [noise=true , address=45.91.116.14:4193 , piece_id=EDQTMMIAJUPGLVLY35AB5E3MAYSSNA6DCRQT5J4MBEAOI5QVZJZQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777177500 (60h40m3.736274747s) [noise=true , address=104.36.82.35:4582 , piece_id=JY7GDQYZ5U3OCIN6X6NRSKPKKBWLHY25FXMEQ6KVAIWBW66SKNRA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.777349525 (60h40m3.736446771s) [noise=true , address=104.36.82.16:4318 , piece_id=CUY56KNQ72C4BTHAHAMFFVAAR4K7MN7LIXOFW7DFQNKSXBUA4NOA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.778725457 (60h40m3.737822703s) [noise=true , address=104.36.82.23:4452 , piece_id=GGUMMVJLZHSEXR63CM2AB6RDXCJ3YFP76CB26YHBJUOGFMCRCXJA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.781541857 (60h40m3.740639092s) [noise=true , address=104.36.82.5:4843 , piece_id=WOPJTONSP36AXUSZ4ATF3N4O733MQHW3RH3Z7YFZWCBNOF5AL55Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782026425 (60h40m3.741123657s) [noise=true , address=104.36.82.58:4280 , piece_id=NMKFSKQZFPHIC2BQ7C3LUICWCEJPT2ZKVWUIX553S7AQG7FNSQ2A, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.782184884 (60h40m3.741282123s) [noise=true , address=104.36.82.39:4747 , piece_id=ZH7UX7JKOZU5PRP2CLRD7XZR5TJPUG4RQUJNOLAPJA4QLTPYPWQQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.795492620 (60h40m3.754589871s) [noise=true , address=104.36.82.62:4437 , piece_id=SWGPQX77TSNHXHAYRELBN2UHWP2MATFTOSQWLYP3NBPUNYN26ZVA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.803902876 (60h40m3.763000122s) [noise=true , address=104.36.82.8:4979 , piece_id=GTLJ5TXMH4BWCT3X5HDQNS7XT4ZMZWJIDFHWJRHRYQB5NNGPNKTA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.806910506 (60h40m3.766007758s) [noise=true , address=104.36.82.61:4408 , piece_id=4UKKHVQ73DDANC44P4NIE4GTTNQV7MDNU6CASTT2HRIFWY3ZLVAQ, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.813618969 (60h40m3.772716206s) [noise=true , address=104.36.82.37:4675 , piece_id=XZQ5O7AUIGQ6A5QDDB6TLRSBOOQUIWVHPGJZ5R7STTIMB5KQRHYA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826793679 (60h40m3.785890928s) [noise=true , address=104.36.82.47:4551 , piece_id=3ZN3AMR7XRNDGEV2HYP3YDTCUCX36FSIGOXWH774ZU7XOQBYRF4Q, seg_pos={0 0}, upload=63178]: Done uploading piece. err: <nil>
Aug 11 06:05:41.826824631 (60h40m3.785921881s) [seg_pos={0 0}, upload=63178]: Segment reached optimal threshold of 14 pieces.
Aug 11 06:05:41.827686129 (60h40m3.786783376s) [noise=true , address=104.36.82.59:4322 , piece_id=LE3ZPG6BP5QMBGX6RAOPDI7EXIJYF3OXHIAXHWRAA6X27V3D3WFA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 11 06:05:41.828112039 (60h40m3.787209288s) [noise=true , address=193.149.164.143:4693 , piece_id=7LG2AJ5GF3XMGGYVUHCTCHQ4MC3TOJSFZCBZVTKMJF3IWDG44AEA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35388->193.149.164.143:4693: use of closed network connection
Aug 11 06:05:41.828239916 (60h40m3.787337163s) [noise=true , address=193.149.164.143:4696 , piece_id=ZKJV6XULJGNAR2QL3BFMEKYWY5ALAUMFWIB3CGIGNAGRJ3SAH6MA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50384->193.149.164.143:4696: use of closed network connection
Aug 11 06:05:41.828382546 (60h40m3.787479798s) [noise=true , address=64.49.13.138:4487 , piece_id=OTWLQXMQ4RH5PDLPTPZFOAG76HKDCK2VQATRF34EOPSXW5X3LKKA, seg_pos={0 0}, upload=63178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53636->64.49.13.138:4487: use of closed network connection
Aug 11 06:05:41.828409620 (60h40m3.787506869s) [seg_pos={0 0}, upload=63178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 06:05:41.828500638 (60h40m3.787597884s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 06:05:41.828507094 (60h40m3.787604355s) [upload=63178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 06:05:41.984124547 (60h40m3.943221803s) [upload=63178]: Done uploading segments...
Aug 11 06:05:41.984150099 (60h40m3.943247351s) [upload=63178]: Upload finished. err: <nil>
Duration: 1.604179961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X....XX.................................................] duration:
823.801055ms
FAIL (2025-08-11 06:05:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.83269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........................X.....X............................] duration:
2.444330231s
FAIL (2025-08-11 06:05:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.444369125s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........................X.....X...........................] duration:
2.336745625s
FAIL (2025-08-11 06:04:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.336806802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X....XX................................................] duration:
845.814971ms
FAIL (2025-08-11 06:04:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.845109ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X........................X.....X..........................] duration:
2.272212952s
FAIL (2025-08-11 06:03:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.27224349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X....XX...............................................] duration:
814.555285ms
FAIL (2025-08-11 06:03:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 814.584338ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X....XX..............................................] duration:
813.490999ms
FAIL (2025-08-11 06:03:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.523652ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X....XX.............................................] duration:
829.331735ms
FAIL (2025-08-11 06:03:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.367195ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X........................X.....X.........................] duration:
2.347582967s
FAIL (2025-08-11 06:02:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.347624202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X....XX............................................] duration:
832.801091ms
FAIL (2025-08-11 06:02:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.839898ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X........................X.....X........................] duration:
2.346031786s
FAIL (2025-08-11 06:02:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.346059279s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X....XX...........................................] duration:
811.662826ms
FAIL (2025-08-11 06:01:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.709923ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X....X........................X.....X.......................] duration:
2.392844804s
FAIL (2025-08-11 06:01:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.392871523s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X....XX..........................................] duration:
831.527581ms
FAIL (2025-08-11 06:01:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.562921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X....XX.........................................] duration:
862.930654ms
FAIL (2025-08-11 06:00:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.963031ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X....X........................X.....X......................] duration:
2.477022144s
FAIL (2025-08-11 06:00:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.477077849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X....XX........................................] duration:
827.054103ms
FAIL (2025-08-11 05:59:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.081678ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X....X........................X.....X.....................] duration:
2.341039407s
FAIL (2025-08-11 05:59:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.341072554s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X....XX.......................................] duration:
2.019837119s
FAIL (2025-08-11 05:59:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.019870106s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X....XX......................................] duration:
824.918114ms
FAIL (2025-08-11 05:58:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.952685ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X....X........................X.....X....................] duration:
2.465203026s
FAIL (2025-08-11 05:58:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.465238429s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X....X........................X.....X...................] duration:
2.672486299s
FAIL (2025-08-11 05:57:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.672523217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X....XX.....................................] duration:
948.17546ms
FAIL (2025-08-11 05:57:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 948.206235ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X....X........................X.....X..................] duration:
2.305825254s
FAIL (2025-08-11 05:57:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.305872496s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X....X........................X.....X.................] duration:
2.255401857s
FAIL (2025-08-11 05:57:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.255490368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X....X........................X.....X................] duration:
2.403390976s
FAIL (2025-08-11 05:57:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.403421977s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X....XX....................................] duration:
909.847815ms
FAIL (2025-08-11 05:57:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 909.885365ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X....XX...................................] duration:
994.981292ms
FAIL (2025-08-11 05:56:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 995.011296ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X....X........................X.....X...............] duration:
2.289284444s
FAIL (2025-08-11 05:56:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.289314838s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X....XX..................................] duration:
864.664622ms
FAIL (2025-08-11 05:55:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.699227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X....X........................X.....X..............] duration:
2.360765792s
FAIL (2025-08-11 05:55:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.360796983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X....XX.................................] duration:
864.124849ms
FAIL (2025-08-11 05:55:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.192775ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X....XX................................] duration:
847.128182ms
FAIL (2025-08-11 05:54:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.152676ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X....X........................X.....X.............] duration:
2.417334267s
FAIL (2025-08-11 05:54:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.41736941s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X....XX...............................] duration:
834.135316ms
FAIL (2025-08-11 05:53:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.162939ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X....X........................X.....X............] duration:
2.33833198s
FAIL (2025-08-11 05:53:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.338361746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X....XX..............................] duration:
896.910929ms
FAIL (2025-08-11 05:52:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 896.945269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X....X........................X.....X...........] duration:
2.501345233s
FAIL (2025-08-11 05:52:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.501376195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X....X........................X.....X..........] duration:
2.534735373s
FAIL (2025-08-11 05:52:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.534766373s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X....XX.............................] duration:
876.57778ms
FAIL (2025-08-11 05:51:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 05:30:59.087718056 (60h5m21.046815295s) [upload=62570]: Starting upload Aug 11 05:30:59.087771660 (60h5m21.046868908s) [upload=62570]: Done starting upload Aug 11 05:30:59.087863620 (60h5m21.046960855s) [upload=62570]: Uploading segments... Aug 11 05:30:59.087922299 (60h5m21.047019554s) [upload=62570]: Got next segment. Inline: true Aug 11 05:30:59.087928788 (60h5m21.04702604s) [upload=62570]: Waiting for error group managing segments... Aug 11 05:30:59.087979998 (60h5m21.047077249s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 05:30:59.087985194 (60h5m21.047082441s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 05:30:59.087988921 (60h5m21.047086175s) [upload=62570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 05:30:59.176434656 (60h5m21.135531901s) [upload=62570]: Done uploading segments... Aug 11 05:30:59.176458491 (60h5m21.135555741s) [upload=62570]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.608567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X....X........................X.....X.........] duration:
2.330184324s
FAIL (2025-08-11 05:51:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:45:24.041090065 (60h19m46.000187319s) [upload=62832]: Starting upload
Aug 11 05:45:24.041160261 (60h19m46.000257506s) [upload=62832]: Done starting upload
Aug 11 05:45:24.041309468 (60h19m46.000406702s) [upload=62832]: Uploading segments...
Aug 11 05:45:24.041651983 (60h19m46.000749224s) [upload=62832]: Got next segment. Inline: false
Aug 11 05:45:24.041712909 (60h19m46.000810154s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:45:24.041718519 (60h19m46.000815765s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:45:24.236136876 (60h19m46.195234136s) [seg_pos={0 0}, upload=62832]: Begin upload segment...
Aug 11 05:45:24.236214238 (60h19m46.195311493s) [seg_pos={0 0}, upload=62832]: Done begin upload segment.
Aug 11 05:45:24.236243607 (60h19m46.19534086s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236250333 (60h19m46.19534758s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236378795 (60h19m46.195476051s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.236814109 (60h19m46.195911365s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237243205 (60h19m46.196340464s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.237667044 (60h19m46.196764303s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238124680 (60h19m46.197221938s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238739505 (60h19m46.197836762s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.238917496 (60h19m46.198014749s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239442402 (60h19m46.198539649s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.239867041 (60h19m46.198964288s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240323558 (60h19m46.199420805s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.240734318 (60h19m46.199831576s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.241607896 (60h19m46.200705143s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242122688 (60h19m46.201219946s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.242676984 (60h19m46.201774251s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243115571 (60h19m46.20221282s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.243463581 (60h19m46.20256083s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Uploading piece...
Aug 11 05:45:24.814377885 (60h19m46.773475137s) [upload=62832]: Next returned nil segment
Aug 11 05:45:24.814400683 (60h19m46.773497939s) [upload=62832]: Waiting for error group managing segments...
Aug 11 05:45:24.967351184 (60h19m46.926448419s) [noise=true , address=77.90.31.12:4612 , piece_id=YLRT46ZCX7D7FV7RWVB7ZCI4C4JO5YG7BACAKNR2NOSFXZ2C6LGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.967441214 (60h19m46.926538461s) [noise=true , address=104.36.82.36:4636 , piece_id=UA2OT5SSQOPJKSDDSH7I65FBWYEH2VQCBYPMPRMYDKC2AGRPF6TQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.976683569 (60h19m46.935780806s) [noise=true , address=104.36.82.58:4275 , piece_id=GT3OP4AIDTROB7AW5VPR63DYBV4R5ZDZAMORXG6BD3QBW37SNUGA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.977374717 (60h19m46.936471965s) [noise=true , address=104.36.82.61:4407 , piece_id=WEYJ4SA7PL3HOYVZ67I73U3ZM7JR4SSNHTAMXANNXFJIMFAUMCWA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980527175 (60h19m46.939624421s) [noise=true , address=104.36.82.42:4803 , piece_id=SWXZNQU3IPEGV34FBE7O55EFHAROVEA5OFYXAZDE6IOZ2Y6GVIXQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.980693187 (60h19m46.939790437s) [noise=true , address=104.36.82.51:4057 , piece_id=S7ANPDKXNW7N672NIPHMHI3ZS3EELU4O7IGE4HEMNFUO6CWLOVEA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.983194900 (60h19m46.942292146s) [noise=true , address=104.36.82.37:4680 , piece_id=2AFYJK3K44FPB52ZWNDS6GMVZKYXQRNC6ZEY6HQGIK4B3ZBLDHGQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:24.992277017 (60h19m46.951374263s) [noise=true , address=104.36.82.19:4424 , piece_id=FNHRT5MZAEIL7HMPCKPNJCVVPTTYLJE6YG4W7PBSJUUYNVPN7LTQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.000753993 (60h19m46.95985126s) [noise=true , address=104.36.82.11:4145 , piece_id=VFU4OXHHBFACORLZKL2GBL6KR42LI5HLOBTPMDAIYIRTAGGD6I4Q, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.016882973 (60h19m46.97598021s) [noise=true , address=104.36.82.55:4205 , piece_id=KZOGJHZHIJKTNL4FAJSRR7XB2OSLC7ZLXBTXW6W4TMCI3PFVN3RA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018219844 (60h19m46.977317089s) [noise=true , address=104.36.82.5:4845 , piece_id=XYYYJUXLXJGHYL3FFVLXRIUKAKXN47Y7YBCQM5BA7IJ44PG4LAFA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.018864204 (60h19m46.977961439s) [noise=true , address=104.36.82.62:4425 , piece_id=LXJHBDWZEMRFM5MEXDM75BK6WTCAHITEWGWWMQWVGRCMVQGDX6JA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.025883107 (60h19m46.984980347s) [noise=true , address=104.36.82.44:4904 , piece_id=QXXAR4ZRV36QKTAZYTSSBQ2OV56GYAHNQICYC4TZO7AOABJZAERA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034333357 (60h19m46.993430595s) [noise=true , address=104.36.82.16:4326 , piece_id=7ZSIX5FVB2XDSVJAPRLRN3MPKUDYE5U4NB5JFS5TZ352XB5HTNUA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: <nil>
Aug 11 05:45:25.034364541 (60h19m46.993461786s) [seg_pos={0 0}, upload=62832]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:45:25.034719971 (60h19m46.993817206s) [noise=true , address=104.36.82.46:4510 , piece_id=KRLM3OQN24NTERHZQASMCLN2VO77EJIGTIXEPWJHFVIRXZ257OMA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034745888 (60h19m46.993843123s) [noise=true , address=104.36.82.40:4951 , piece_id=OLG5GAGGU7XAXSYBE2KIEONQSVOXWXAYRQPVY5IVE3UNBYOCKZKQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg): protocol: expected piece hash; context canceled; EOF
Aug 11 05:45:25.034833131 (60h19m46.993930367s) [noise=true , address=193.149.164.143:4697 , piece_id=VDN6RUPKMYOWPMEUM2ZCZX6VK4UXMHANCVE3MRR7G6OYRYFQLWZA, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52680->193.149.164.143:4697: use of closed network connection
Aug 11 05:45:25.034967790 (60h19m46.994065039s) [noise=true , address=64.49.13.169:4705 , piece_id=XZKMRYM6YDVLFCRPMU3BKIVIS4YS6D7FNXEDZPBGXHUMBACZIZSQ, seg_pos={0 0}, upload=62832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uqzVwsF5TM4CwUhkzfJvgxd71jZXgXuFNwDLRW1vrSXbwLsr): protocol: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45612->64.49.13.169:4705: use of closed network connection
Aug 11 05:45:25.034997347 (60h19m46.994094603s) [seg_pos={0 0}, upload=62832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:45:25.035133262 (60h19m46.994230508s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:45:25.035139275 (60h19m46.99423652s) [upload=62832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:45:25.320455422 (60h19m47.279552667s) [upload=62832]: Done uploading segments...
Aug 11 05:45:25.320475461 (60h19m47.279572699s) [upload=62832]: Upload finished. err: <nil>
Duration: 2.330210877s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|