Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.052678345s
FAIL (2025-08-11 19:33:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:31:32.890585237 (74h5m54.849682494s) [upload=77230]: Starting upload Aug 11 19:31:32.890664861 (74h5m54.849762121s) [upload=77230]: Done starting upload Aug 11 19:31:32.890764772 (74h5m54.849862025s) [upload=77230]: Uploading segments... Aug 11 19:31:32.890846707 (74h5m54.849943963s) [upload=77230]: Got next segment. Inline: true Aug 11 19:31:32.890853433 (74h5m54.849950691s) [upload=77230]: Waiting for error group managing segments... Aug 11 19:31:32.890911177 (74h5m54.850008431s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:31:32.890917708 (74h5m54.850014963s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 19:31:32.890923114 (74h5m54.85002037s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 19:31:32.980336567 (74h5m54.939433815s) [upload=77230]: Done uploading segments... Aug 11 19:31:32.980368333 (74h5m54.939465577s) [upload=77230]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.052735141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X....................X.............] duration:
2.490818608s
FAIL (2025-08-11 19:32:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.490848516s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.176158321s
FAIL (2025-08-11 19:32:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:31:32.890585237 (74h5m54.849682494s) [upload=77230]: Starting upload Aug 11 19:31:32.890664861 (74h5m54.849762121s) [upload=77230]: Done starting upload Aug 11 19:31:32.890764772 (74h5m54.849862025s) [upload=77230]: Uploading segments... Aug 11 19:31:32.890846707 (74h5m54.849943963s) [upload=77230]: Got next segment. Inline: true Aug 11 19:31:32.890853433 (74h5m54.849950691s) [upload=77230]: Waiting for error group managing segments... Aug 11 19:31:32.890911177 (74h5m54.850008431s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:31:32.890917708 (74h5m54.850014963s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 19:31:32.890923114 (74h5m54.85002037s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 19:31:32.980336567 (74h5m54.939433815s) [upload=77230]: Done uploading segments... Aug 11 19:31:32.980368333 (74h5m54.939465577s) [upload=77230]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.176179747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X....................X............] duration:
2.395058138s
FAIL (2025-08-11 19:31:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.395083927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
365.44614ms
FAIL (2025-08-11 19:31:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:31:32.890585237 (74h5m54.849682494s) [upload=77230]: Starting upload Aug 11 19:31:32.890664861 (74h5m54.849762121s) [upload=77230]: Done starting upload Aug 11 19:31:32.890764772 (74h5m54.849862025s) [upload=77230]: Uploading segments... Aug 11 19:31:32.890846707 (74h5m54.849943963s) [upload=77230]: Got next segment. Inline: true Aug 11 19:31:32.890853433 (74h5m54.849950691s) [upload=77230]: Waiting for error group managing segments... Aug 11 19:31:32.890911177 (74h5m54.850008431s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:31:32.890917708 (74h5m54.850014963s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 19:31:32.890923114 (74h5m54.85002037s) [upload=77230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 19:31:32.980336567 (74h5m54.939433815s) [upload=77230]: Done uploading segments... Aug 11 19:31:32.980368333 (74h5m54.939465577s) [upload=77230]: Upload finished. err: metaclient: Too Many Requests
Duration: 365.477667ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X....................X...........] duration:
2.404540908s
FAIL (2025-08-11 19:30:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.404764567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X....................X..........] duration:
2.945401924s
FAIL (2025-08-11 19:30:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.945440171s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X............................X....................X.........] duration:
2.538492048s
FAIL (2025-08-11 19:29:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.538519703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X............................X....................X........] duration:
2.680298094s
FAIL (2025-08-11 19:29:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.680327494s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X............................X....................X.......] duration:
2.496181036s
FAIL (2025-08-11 19:28:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.496214585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
861.013719ms
FAIL (2025-08-11 19:27:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.039452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X............................X....................X......] duration:
2.919108933s
FAIL (2025-08-11 19:27:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.919209725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X............................X....................X.....] duration:
2.430255875s
FAIL (2025-08-11 19:27:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.430318651s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
888.050185ms
FAIL (2025-08-11 19:27:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 888.084486ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.234198983s
FAIL (2025-08-11 19:26:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.234229714s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X............................X....................X....] duration:
2.344874502s
FAIL (2025-08-11 19:26:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.344905747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X............................X....................X...] duration:
2.737048828s
FAIL (2025-08-11 19:26:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.737187911s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X............................X....................X..] duration:
2.431371628s
FAIL (2025-08-11 19:25:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.431418464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
867.177919ms
FAIL (2025-08-11 19:25:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.211392ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X...X.......................................................] duration:
829.637226ms
FAIL (2025-08-11 19:25:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.725687ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X............................X....................X.] duration:
2.535470086s
FAIL (2025-08-11 19:24:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.535505225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X...X......................................................] duration:
1.107385685s
FAIL (2025-08-11 19:24:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.107443029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X............................X....................X] duration:
2.15868299s
FAIL (2025-08-11 19:23:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 19:23:53.814781502 (73h58m15.773878736s) [upload=77097]: Starting upload
Aug 11 19:23:53.814866345 (73h58m15.773963577s) [upload=77097]: Done starting upload
Aug 11 19:23:53.815006239 (73h58m15.774103473s) [upload=77097]: Uploading segments...
Aug 11 19:23:53.815510179 (73h58m15.774607425s) [upload=77097]: Got next segment. Inline: false
Aug 11 19:23:53.815556446 (73h58m15.774653693s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 19:23:53.815561956 (73h58m15.774659204s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 19:23:54.017188345 (73h58m15.976285597s) [seg_pos={0 0}, upload=77097]: Begin upload segment...
Aug 11 19:23:54.017276537 (73h58m15.976373784s) [seg_pos={0 0}, upload=77097]: Done begin upload segment.
Aug 11 19:23:54.017322585 (73h58m15.976419838s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017593181 (73h58m15.976690455s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.017961033 (73h58m15.977058291s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018100002 (73h58m15.977197256s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018418968 (73h58m15.977516216s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018516099 (73h58m15.977613347s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.018726021 (73h58m15.977823257s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019016110 (73h58m15.978113362s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019034598 (73h58m15.97813185s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019336789 (73h58m15.978434039s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019579420 (73h58m15.978676677s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019646673 (73h58m15.978743923s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.019970304 (73h58m15.979067561s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020190337 (73h58m15.979287593s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020434111 (73h58m15.979531367s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.020707363 (73h58m15.979804612s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021134927 (73h58m15.980232179s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.021616534 (73h58m15.98071379s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Uploading piece...
Aug 11 19:23:54.581434379 (73h58m16.540531625s) [upload=77097]: Next returned nil segment
Aug 11 19:23:54.581510564 (73h58m16.54060781s) [upload=77097]: Waiting for error group managing segments...
Aug 11 19:23:54.771210732 (73h58m16.730307971s) [noise=true , address=104.36.82.12:4164 , piece_id=UXZSILREPDLF2SAQVSGD5BPKYAO2YFE6Z5V77BGOQGDDRCHJEMMA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.775093684 (73h58m16.734190924s) [noise=true , address=104.36.82.19:4424 , piece_id=5MN52HXRPBQUDARPCSEEIAA6EDUW6H5QGVUW7XMMBGOVEYP76X5A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.780852304 (73h58m16.739949543s) [noise=true , address=104.36.82.46:4483 , piece_id=LE2VJJSWLCWCW2QMXGPSNQVHDHUSZXJ75RWD2HO4AJ3QGXSHGLRA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.782809489 (73h58m16.741906737s) [noise=true , address=104.36.82.62:4410 , piece_id=LKUPLGVI6VMSDV5IIZJXOZ4ZNCE3XGRNCHGVUMACL5LMZHMLLTZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789379663 (73h58m16.748476895s) [noise=true , address=104.36.82.23:4455 , piece_id=FYS7SKTPTYQDVDVSPUSLBOUH6WIWPO5ZTPFEPBXMRD6NKBNJCKZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789863590 (73h58m16.748960821s) [noise=true , address=104.36.82.39:4745 , piece_id=RI7VWPA4CUL2AGIZEKXZCTMFA5TZVP7YOYZGIYCCX5W4WQGW26ZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.789954095 (73h58m16.749051342s) [noise=true , address=104.36.82.18:4370 , piece_id=GKQUKV22S6YCI4AGECMH33ULDMSIISILTZKSS5S3PYYKY2XZSEZQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.790263043 (73h58m16.749360275s) [noise=true , address=104.36.82.61:4382 , piece_id=3OZKFZ2UZDVA56T2CHP2DPUPSVNX2RHTNYODOYF6DAOS5F3LKMFQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.795485398 (73h58m16.754582632s) [noise=true , address=104.36.82.43:4862 , piece_id=7XSNHN4QQAOJKPPYJHVFIZREGFZG7NRDAX7CXJIBOODFKELY64CQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.796161780 (73h58m16.755259026s) [noise=true , address=104.36.82.34:4560 , piece_id=W2C2OMSTJPIBFYW64NZWEVPIOLWJ53GIWP2VOEBPURI6OTB5CK6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.801784933 (73h58m16.760882174s) [noise=true , address=104.36.82.14:4244 , piece_id=D3R2YGYHQYM2OPRBR37BEWT6YYAIITGGDR72XE7OV37OYITIP52Q, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.802064834 (73h58m16.76116207s) [noise=true , address=104.36.82.56:4249 , piece_id=34FZKSA7Z72XAVRURPP3455ZS2PUH23V2RKRMJJACKCUDIIVLPBA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:54.844822899 (73h58m16.803920134s) [noise=true , address=104.36.82.59:4303 , piece_id=6ZB2OVAUJBICEAZ6N6FYUCXEDNMZSGDHH5X5CFMRNY6BVEF5CR4A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078793943 (73h58m17.03789119s) [noise=true , address=79.127.201.215:4325 , piece_id=WSANGSRCYE3CJR346APSUCDJGMMEY2YP4WD2GR52C337S2G5JJ6A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: <nil>
Aug 11 19:23:55.078826574 (73h58m17.037923807s) [seg_pos={0 0}, upload=77097]: Segment reached optimal threshold of 14 pieces.
Aug 11 19:23:55.079018309 (73h58m17.03811556s) [noise=true , address=79.127.205.235:4679 , piece_id=S7MZMRJF7IKLQFCKZEVG3MLISVZTMVSE565AYAMOWWGPWNTNILYA, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CG9uszCxDZrsit38UcJNfTH3XWMDGCcb1u4FPQ6xkTD7ePV5u): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085480637 (73h58m17.044577877s) [noise=true , address=64.49.13.27:4966 , piece_id=QZ3CI2PJSCS2TWJIJBV2YCZ3OUI4U2MO2NQCGPW7CP2BUHL7DMPQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUV64TP8cTQhBjswnhcWfQHwYEEWqr5ASuPjtEx3X6ZQNVhS5): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.085570556 (73h58m17.044667795s) [noise=true , address=104.36.82.47:4549 , piece_id=A6HKFUHGIYON3LI7RDG6PCAJETKBB7ASNY643RQEQ7GPL2KXZV2A, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF
Aug 11 19:23:55.093833645 (73h58m17.052930883s) [noise=true , address=79.127.205.233:4622 , piece_id=VAJBEUM7MF5P73XB6VDUMOGMAD2Y4XBRR7K7K556C4XP2JCOEQLQ, seg_pos={0 0}, upload=77097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UuQEvB9P7nd6f9ddhfb98hiFXAFXFkGePFdpbpVgEPpJMsWRc): internal: context canceled
Aug 11 19:23:55.093945519 (73h58m17.053042765s) [seg_pos={0 0}, upload=77097]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 19:23:55.094065069 (73h58m17.053162316s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 19:23:55.094109797 (73h58m17.053207083s) [upload=77097]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 19:23:55.401316539 (73h58m17.360413775s) [upload=77097]: Done uploading segments...
Aug 11 19:23:55.401337552 (73h58m17.360434792s) [upload=77097]: Upload finished. err: <nil>
Duration: 2.158711695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X...X.....................................................] duration:
1.151774357s
FAIL (2025-08-11 19:23:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.151804136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X............................X....................] duration:
2.534371938s
FAIL (2025-08-11 19:22:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.534405198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X............................X...................] duration:
2.464479662s
FAIL (2025-08-11 19:22:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.46453903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X...X....................................................] duration:
873.809329ms
FAIL (2025-08-11 19:22:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.838921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X...X...................................................] duration:
2.395342415s
FAIL (2025-08-11 19:21:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.395401085s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X............................X..................] duration:
2.744621968s
FAIL (2025-08-11 19:21:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.74465856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X...X..................................................] duration:
1.099248671s
FAIL (2025-08-11 19:21:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.099286029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X............................X.................] duration:
2.573573632s
FAIL (2025-08-11 19:20:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.573602185s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X...X.................................................] duration:
1.350990704s
FAIL (2025-08-11 19:20:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.351028834s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X............................X................] duration:
2.52300161s
FAIL (2025-08-11 19:19:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.523032477s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X...X................................................] duration:
853.287527ms
FAIL (2025-08-11 19:18:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.314795ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.......X...X...............................................] duration:
1.079179052s
FAIL (2025-08-11 19:18:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.079202692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..............X............................X...............] duration:
2.593384368s
FAIL (2025-08-11 19:18:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.593419011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X...X..............................................] duration:
967.842858ms
FAIL (2025-08-11 19:17:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 967.904286ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..............X............................X..............] duration:
2.528754769s
FAIL (2025-08-11 19:17:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.528783796s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X...X.............................................] duration:
997.005161ms
FAIL (2025-08-11 19:16:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 997.040892ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X..............X............................X.............] duration:
2.704019033s
FAIL (2025-08-11 19:16:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.704119168s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X...X............................................] duration:
966.217446ms
FAIL (2025-08-11 19:16:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 966.258738ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X..............X............................X............] duration:
2.69322115s
FAIL (2025-08-11 19:16:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.693283027s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X...X...........................................] duration:
1.231745976s
FAIL (2025-08-11 19:15:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.231907539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X..............X............................X...........] duration:
2.753108918s
FAIL (2025-08-11 19:15:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.753149862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X...X..........................................] duration:
917.192015ms
FAIL (2025-08-11 19:14:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 917.244268ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X..............X............................X..........] duration:
2.730228219s
FAIL (2025-08-11 19:14:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.730266365s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X..............X............................X.........] duration:
2.586737204s
FAIL (2025-08-11 19:13:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.586768808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X...X.........................................] duration:
934.735701ms
FAIL (2025-08-11 19:13:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 934.763406ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X..............X............................X........] duration:
2.536626234s
FAIL (2025-08-11 19:12:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 19:08:18.088076617 (73h42m40.047173863s) [upload=76828]: Starting upload Aug 11 19:08:18.088207298 (73h42m40.047304554s) [upload=76828]: Done starting upload Aug 11 19:08:18.088439762 (73h42m40.04753701s) [upload=76828]: Uploading segments... Aug 11 19:08:18.089528387 (73h42m40.048625675s) [upload=76828]: Got next segment. Inline: false Aug 11 19:08:18.089618399 (73h42m40.048715656s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 19:08:18.089661413 (73h42m40.048758671s) [upload=76828]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 19:08:18.180247463 (73h42m40.139344699s) [upload=76828]: Next segment err: metaclient: Too Many Requests Aug 11 19:08:18.180291413 (73h42m40.139388659s) [upload=76828]: Done uploading segments... Aug 11 19:08:18.180309385 (73h42m40.139406624s) [upload=76828]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.536660932s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X...X........................................] duration:
865.906942ms
FAIL (2025-08-11 19:12:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.93295ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|