Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X........................................X.......] duration:
914.683628ms
FAIL (2025-08-10 12:38:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 914.719686ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X.......X.........X.............] duration:
2.393952174s
FAIL (2025-08-10 12:38:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.393973727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X........................................X......] duration:
869.404479ms
FAIL (2025-08-10 12:37:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.435ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X.......X.........X............] duration:
2.384309648s
FAIL (2025-08-10 12:37:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.384347189s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.......X.........X...........] duration:
2.445615731s
FAIL (2025-08-10 12:37:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.445648942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.......X.........X..........] duration:
2.378097111s
FAIL (2025-08-10 12:36:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.378126926s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................................X.....] duration:
946.354194ms
FAIL (2025-08-10 12:36:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 946.386919ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X.......X.........X.........] duration:
2.384820365s
FAIL (2025-08-10 12:35:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.384856799s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.......X.........X........] duration:
2.494156971s
FAIL (2025-08-10 12:35:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.494252087s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................................X....] duration:
849.653435ms
FAIL (2025-08-10 12:35:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.684204ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X.......X.........X.......] duration:
2.47310003s
FAIL (2025-08-10 12:34:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.473134594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................................X...] duration:
965.920755ms
FAIL (2025-08-10 12:34:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 965.955435ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................X.......X.........X......] duration:
2.571728682s
FAIL (2025-08-10 12:34:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.57176127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X........................................X..] duration:
977.915305ms
FAIL (2025-08-10 12:34:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 977.943593ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................................X.......X.........X.....] duration:
2.444003346s
FAIL (2025-08-10 12:33:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.444032682s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X.......X.........X....] duration:
2.421208084s
FAIL (2025-08-10 12:33:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.42124089s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................................X.] duration:
832.606626ms
FAIL (2025-08-10 12:32:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.632958ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................................X] duration:
378.821495ms
FAIL (2025-08-10 12:32:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:32:19.788073490 (43h6m41.747170736s) [upload=44923]: Starting upload Aug 10 12:32:19.788257009 (43h6m41.747354262s) [upload=44923]: Done starting upload Aug 10 12:32:19.788391576 (43h6m41.747488824s) [upload=44923]: Uploading segments... Aug 10 12:32:19.788477418 (43h6m41.747574725s) [upload=44923]: Got next segment. Inline: true Aug 10 12:32:19.788486781 (43h6m41.747584036s) [upload=44923]: Waiting for error group managing segments... Aug 10 12:32:19.788568516 (43h6m41.747665765s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:32:19.788575277 (43h6m41.747672527s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:32:19.788579177 (43h6m41.74767643s) [upload=44923]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:32:19.894475319 (43h6m41.853572556s) [upload=44923]: Done uploading segments... Aug 10 12:32:19.894495002 (43h6m41.853592249s) [upload=44923]: Upload finished. err: metaclient: Too Many Requests
Duration: 378.843186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................................X.......X.........X...] duration:
2.532827242s
FAIL (2025-08-10 12:31:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.532860499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.019545232s
FAIL (2025-08-10 12:31:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.019593013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................................X.......X.........X..] duration:
2.367811734s
FAIL (2025-08-10 12:30:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.367913047s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.153153697s
FAIL (2025-08-10 12:30:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.153187456s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................................X.......X.........X.] duration:
2.43637603s
FAIL (2025-08-10 12:29:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 2.436488856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................................X.......X.........X] duration:
1.720441608s
FAIL (2025-08-10 12:29:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:29:19.086936185 (43h3m41.04603343s) [upload=44870]: Starting upload
Aug 10 12:29:19.086996775 (43h3m41.04609403s) [upload=44870]: Done starting upload
Aug 10 12:29:19.087212299 (43h3m41.046309547s) [upload=44870]: Uploading segments...
Aug 10 12:29:19.087359278 (43h3m41.046456518s) [upload=44870]: Got next segment. Inline: false
Aug 10 12:29:19.087433383 (43h3m41.046530621s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:29:19.087439263 (43h3m41.046536509s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:29:19.282907139 (43h3m41.242004387s) [seg_pos={0 0}, upload=44870]: Begin upload segment...
Aug 10 12:29:19.282980227 (43h3m41.242077472s) [seg_pos={0 0}, upload=44870]: Done begin upload segment.
Aug 10 12:29:19.283025547 (43h3m41.242122802s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283039708 (43h3m41.242136959s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283122437 (43h3m41.242219691s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283468347 (43h3m41.242565592s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283557367 (43h3m41.242654612s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283775797 (43h3m41.242873044s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.283982963 (43h3m41.243080219s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.284599811 (43h3m41.243697066s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285000835 (43h3m41.244098089s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285143984 (43h3m41.244241242s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285339946 (43h3m41.244437191s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.285665176 (43h3m41.244762427s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286029659 (43h3m41.24512691s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286113334 (43h3m41.245210591s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286464029 (43h3m41.245561286s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.286807085 (43h3m41.245904334s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287143621 (43h3m41.246240876s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.287461717 (43h3m41.246558965s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Uploading piece...
Aug 10 12:29:19.836891434 (43h3m41.79598868s) [upload=44870]: Next returned nil segment
Aug 10 12:29:19.836912268 (43h3m41.796009515s) [upload=44870]: Waiting for error group managing segments...
Aug 10 12:29:20.006024540 (43h3m41.965121778s) [noise=true , address=104.36.82.60:4353 , piece_id=FVFIW4MDCK7ETLGL27EQANL4V2W44II5VIFUBAWAV2TVN74ILQXA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.017036525 (43h3m41.97613377s) [noise=true , address=104.36.82.59:4336 , piece_id=YBMXHJHMRJ3VB5ERCWOLOFOYGJH2TIXCDLKKRBJFLOXZR72LSA3Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.018552634 (43h3m41.977649879s) [noise=true , address=104.36.82.46:4483 , piece_id=2H7R67VXHRJCMITUZGGYMJUB43TYUDCECV66ZEOIHPF5ZU4BHC4Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.023396636 (43h3m41.982493874s) [noise=true , address=45.91.116.14:4221 , piece_id=KKDZROJ2QJMMXKQVL3V7OAF5FUPL443NU3XI4TBKMNVVWK3LTWHQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024335733 (43h3m41.983432969s) [noise=true , address=104.36.82.16:4312 , piece_id=JS4N6R546NWTTWKKOCSGCBVE2VLAPA7RUEAAVR35RBINJ6VGAB7Q, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024489166 (43h3m41.983586402s) [noise=true , address=104.36.82.61:4407 , piece_id=ARRYOEWT2AEQJ7KBC63DZUXDL63RG52BU33OCBG2DRKW7LGBZFEA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.024810553 (43h3m41.983907788s) [noise=true , address=45.91.116.13:4157 , piece_id=KIXLNOB7KAZMGQM4WXJNLLLQWLL6F43RJ34KWYT6ZUPD4RO7DJRQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.027249619 (43h3m41.986346867s) [noise=true , address=104.36.82.7:4917 , piece_id=IJHT4EQMGU7KEQTOKK3BMHIT3RNAOBAUOYA4I2MRHHSR7L7ZZRVA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.028330451 (43h3m41.987427696s) [noise=true , address=104.36.82.8:4997 , piece_id=YKP764CPHTA32A44ZSX55N2BOKLKREZEM7I6FW5JU24YB23RXWYA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.032929587 (43h3m41.992026825s) [noise=true , address=104.36.82.38:4724 , piece_id=5JZMINUKLR62FMIFYGNHXF47YU3GRQL7ADF2CYZSLLG33MN4EEGA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.033492250 (43h3m41.992589497s) [noise=true , address=104.36.82.47:4547 , piece_id=K6E2VKSEHZTSTLL4LZEL6IXD3XSFVUODG7HCYR23VUV3OXKEXFBA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.034106778 (43h3m41.993204025s) [noise=true , address=104.36.82.21:4486 , piece_id=ATY2JIH2WO4RJTGYE7B3KLT3H2HPCS5LC52ZQH4ZVI35L4NM3RDA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.039938983 (43h3m41.999036222s) [noise=true , address=104.36.82.62:4414 , piece_id=Z3UXJQCFDPFWTS6FIXJXIU4244S6HGNXX2J6M6EZG74IHCLMWFEQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040859922 (43h3m41.999957169s) [noise=true , address=104.36.82.54:4162 , piece_id=DXIJJZ2KYHFLLQLMENJE7MXW5YMZRT6G2KFHXJJA6FTX4ECLM3ZQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.040882062 (43h3m41.999979314s) [seg_pos={0 0}, upload=44870]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:29:20.041044001 (43h3m42.000141252s) [noise=true , address=104.36.82.44:4894 , piece_id=XHATFKQXP3GVSQZHJ5VGM2W4CGV6JCKDBYQWDJC3OCP3MSKJ44LQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041190980 (43h3m42.000288229s) [noise=true , address=104.36.82.36:4620 , piece_id=ACY6QJARVL5B6I47DQI4UPAXJSVBTDU3WW7N33I6NBN2FMACHACA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041298614 (43h3m42.000395861s) [noise=true , address=104.36.82.37:4687 , piece_id=ORX7CGJ3TPYB4F72PDDEUD7SPANTCWKBLIB66RDPFHKBP5PBFBKQ, seg_pos={0 0}, upload=44870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:29:20.041314108 (43h3m42.000411347s) [noise=true , address=104.36.82.12:4160 , piece_id=YVTF5P5FS4TJFPOQIES5SR3ZTUDHOQCIGE7KR2FKUQZ56AAVIIJA, seg_pos={0 0}, upload=44870]: Done uploading piece. err: <nil>
Aug 10 12:29:20.041337607 (43h3m42.000434845s) [seg_pos={0 0}, upload=44870]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 10 12:29:20.041418706 (43h3m42.000515951s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:29:20.041423932 (43h3m42.000521177s) [upload=44870]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:29:20.328544455 (43h3m42.287641691s) [upload=44870]: Done uploading segments...
Aug 10 12:29:20.328564723 (43h3m42.287661961s) [upload=44870]: Upload finished. err: <nil>
Duration: 1.720475124s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
892.244511ms
FAIL (2025-08-10 12:29:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.270627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.......X.........] duration:
2.537556269s
FAIL (2025-08-10 12:28:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.537609562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.......X........] duration:
2.37073098s
FAIL (2025-08-10 12:28:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.370762893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
814.676042ms
FAIL (2025-08-10 12:28:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 814.703365ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
811.478832ms
FAIL (2025-08-10 12:27:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.578943ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.......X.......] duration:
2.487800023s
FAIL (2025-08-10 12:27:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.487841476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
941.997331ms
FAIL (2025-08-10 12:26:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 942.027075ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.......X......] duration:
2.705883896s
FAIL (2025-08-10 12:26:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.705913917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
936.384674ms
FAIL (2025-08-10 12:26:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 936.422695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
823.592918ms
FAIL (2025-08-10 12:25:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.680635ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.......X.....] duration:
2.425346005s
FAIL (2025-08-10 12:25:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.425434785s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.......X....] duration:
3.017766827s
FAIL (2025-08-10 12:24:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.017801513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
861.912532ms
FAIL (2025-08-10 12:24:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.944516ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
833.825922ms
FAIL (2025-08-10 12:23:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.85344ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.......X...] duration:
2.37244189s
FAIL (2025-08-10 12:23:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.372479743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.......X..] duration:
2.443040352s
FAIL (2025-08-10 12:22:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.443078193s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
906.49028ms
FAIL (2025-08-10 12:22:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 906.52312ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.......X.] duration:
2.317973273s
FAIL (2025-08-10 12:21:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.318005022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.......X] duration:
382.309453ms
FAIL (2025-08-10 12:21:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:21:16.842926127 (42h55m38.802023379s) [upload=44727]: Starting upload Aug 10 12:21:16.843023021 (42h55m38.802120267s) [upload=44727]: Done starting upload Aug 10 12:21:16.843147497 (42h55m38.802244743s) [upload=44727]: Uploading segments... Aug 10 12:21:16.843415470 (42h55m38.802512725s) [upload=44727]: Got next segment. Inline: false Aug 10 12:21:16.843477285 (42h55m38.802574531s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:21:16.843483529 (42h55m38.802580775s) [upload=44727]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:21:16.932863538 (42h55m38.891960795s) [upload=44727]: Next segment err: metaclient: Too Many Requests Aug 10 12:21:16.932891726 (42h55m38.891988961s) [upload=44727]: Done uploading segments... Aug 10 12:21:16.932911472 (42h55m38.892008718s) [upload=44727]: Upload finished. err: metaclient: Too Many Requests
Duration: 382.338978ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
839.439866ms
FAIL (2025-08-10 12:21:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.485765ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.385886551s
FAIL (2025-08-10 12:20:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:15:34.181559613 (42h49m56.140656847s) [upload=44626]: Starting upload
Aug 10 12:15:34.181629530 (42h49m56.140726778s) [upload=44626]: Done starting upload
Aug 10 12:15:34.181725110 (42h49m56.140822342s) [upload=44626]: Uploading segments...
Aug 10 12:15:34.182085247 (42h49m56.141182517s) [upload=44626]: Got next segment. Inline: false
Aug 10 12:15:34.182152380 (42h49m56.141249625s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:15:34.182158726 (42h49m56.141255972s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:15:34.381948724 (42h49m56.341045968s) [seg_pos={0 0}, upload=44626]: Begin upload segment...
Aug 10 12:15:34.382014197 (42h49m56.341111431s) [seg_pos={0 0}, upload=44626]: Done begin upload segment.
Aug 10 12:15:34.382054116 (42h49m56.341151362s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382062995 (42h49m56.341160244s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382133334 (42h49m56.341230586s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382485100 (42h49m56.341582346s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382529057 (42h49m56.341626301s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382807752 (42h49m56.341904997s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383089480 (42h49m56.342186729s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383664074 (42h49m56.342761326s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386047065 (42h49m56.345144315s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386905105 (42h49m56.346002363s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387383688 (42h49m56.346480943s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387748522 (42h49m56.346845774s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388169432 (42h49m56.347266687s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388518528 (42h49m56.347615782s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388894089 (42h49m56.347991343s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389264527 (42h49m56.348361803s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389530288 (42h49m56.348627541s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389907245 (42h49m56.349004497s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.926564978 (42h49m56.885662209s) [upload=44626]: Next returned nil segment
Aug 10 12:15:34.926585943 (42h49m56.885683188s) [upload=44626]: Waiting for error group managing segments...
Aug 10 12:15:35.107788679 (42h49m57.066885917s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.108349025 (42h49m57.067446273s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.109118421 (42h49m57.068215657s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.117182262 (42h49m57.076279493s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129486809 (42h49m57.088584058s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129726897 (42h49m57.08882413s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131167259 (42h49m57.090264506s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131906506 (42h49m57.091003744s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134401397 (42h49m57.093498635s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134801233 (42h49m57.09389847s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.137397310 (42h49m57.096494549s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.150789559 (42h49m57.109886805s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.159186711 (42h49m57.118283949s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160841937 (42h49m57.119939185s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160864771 (42h49m57.119962018s) [seg_pos={0 0}, upload=44626]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:15:35.161010285 (42h49m57.12010753s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161311875 (42h49m57.120409121s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129pP9f3rFfTvP6MhG894N7WHuJRZP8aWhzJf1zBwZ76wbzVbZa): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161463897 (42h49m57.120561152s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx): protocol: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection
Aug 10 12:15:35.161548682 (42h49m57.120645928s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection
Aug 10 12:15:35.161564252 (42h49m57.120661507s) [seg_pos={0 0}, upload=44626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:15:35.161650866 (42h49m57.120748113s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:15:35.161657297 (42h49m57.120754555s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:15:35.370393179 (42h49m57.329490424s) [upload=44626]: Done uploading segments...
Aug 10 12:15:35.370413987 (42h49m57.329511225s) [upload=44626]: Upload finished. err: <nil>
Duration: 2.385921386s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
906.073185ms
FAIL (2025-08-10 12:20:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 906.107344ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.366341972s
FAIL (2025-08-10 12:19:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:15:34.181559613 (42h49m56.140656847s) [upload=44626]: Starting upload
Aug 10 12:15:34.181629530 (42h49m56.140726778s) [upload=44626]: Done starting upload
Aug 10 12:15:34.181725110 (42h49m56.140822342s) [upload=44626]: Uploading segments...
Aug 10 12:15:34.182085247 (42h49m56.141182517s) [upload=44626]: Got next segment. Inline: false
Aug 10 12:15:34.182152380 (42h49m56.141249625s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:15:34.182158726 (42h49m56.141255972s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:15:34.381948724 (42h49m56.341045968s) [seg_pos={0 0}, upload=44626]: Begin upload segment...
Aug 10 12:15:34.382014197 (42h49m56.341111431s) [seg_pos={0 0}, upload=44626]: Done begin upload segment.
Aug 10 12:15:34.382054116 (42h49m56.341151362s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382062995 (42h49m56.341160244s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382133334 (42h49m56.341230586s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382485100 (42h49m56.341582346s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382529057 (42h49m56.341626301s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382807752 (42h49m56.341904997s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383089480 (42h49m56.342186729s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383664074 (42h49m56.342761326s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386047065 (42h49m56.345144315s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386905105 (42h49m56.346002363s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387383688 (42h49m56.346480943s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387748522 (42h49m56.346845774s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388169432 (42h49m56.347266687s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388518528 (42h49m56.347615782s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388894089 (42h49m56.347991343s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389264527 (42h49m56.348361803s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389530288 (42h49m56.348627541s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389907245 (42h49m56.349004497s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.926564978 (42h49m56.885662209s) [upload=44626]: Next returned nil segment
Aug 10 12:15:34.926585943 (42h49m56.885683188s) [upload=44626]: Waiting for error group managing segments...
Aug 10 12:15:35.107788679 (42h49m57.066885917s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.108349025 (42h49m57.067446273s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.109118421 (42h49m57.068215657s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.117182262 (42h49m57.076279493s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129486809 (42h49m57.088584058s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129726897 (42h49m57.08882413s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131167259 (42h49m57.090264506s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131906506 (42h49m57.091003744s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134401397 (42h49m57.093498635s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134801233 (42h49m57.09389847s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.137397310 (42h49m57.096494549s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.150789559 (42h49m57.109886805s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.159186711 (42h49m57.118283949s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160841937 (42h49m57.119939185s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160864771 (42h49m57.119962018s) [seg_pos={0 0}, upload=44626]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:15:35.161010285 (42h49m57.12010753s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161311875 (42h49m57.120409121s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129pP9f3rFfTvP6MhG894N7WHuJRZP8aWhzJf1zBwZ76wbzVbZa): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161463897 (42h49m57.120561152s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx): protocol: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection
Aug 10 12:15:35.161548682 (42h49m57.120645928s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection
Aug 10 12:15:35.161564252 (42h49m57.120661507s) [seg_pos={0 0}, upload=44626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:15:35.161650866 (42h49m57.120748113s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:15:35.161657297 (42h49m57.120754555s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:15:35.370393179 (42h49m57.329490424s) [upload=44626]: Done uploading segments...
Aug 10 12:15:35.370413987 (42h49m57.329511225s) [upload=44626]: Upload finished. err: <nil>
Duration: 2.366378768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.462398918s
FAIL (2025-08-10 12:19:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:15:34.181559613 (42h49m56.140656847s) [upload=44626]: Starting upload
Aug 10 12:15:34.181629530 (42h49m56.140726778s) [upload=44626]: Done starting upload
Aug 10 12:15:34.181725110 (42h49m56.140822342s) [upload=44626]: Uploading segments...
Aug 10 12:15:34.182085247 (42h49m56.141182517s) [upload=44626]: Got next segment. Inline: false
Aug 10 12:15:34.182152380 (42h49m56.141249625s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:15:34.182158726 (42h49m56.141255972s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:15:34.381948724 (42h49m56.341045968s) [seg_pos={0 0}, upload=44626]: Begin upload segment...
Aug 10 12:15:34.382014197 (42h49m56.341111431s) [seg_pos={0 0}, upload=44626]: Done begin upload segment.
Aug 10 12:15:34.382054116 (42h49m56.341151362s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382062995 (42h49m56.341160244s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382133334 (42h49m56.341230586s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382485100 (42h49m56.341582346s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382529057 (42h49m56.341626301s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382807752 (42h49m56.341904997s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383089480 (42h49m56.342186729s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383664074 (42h49m56.342761326s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386047065 (42h49m56.345144315s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386905105 (42h49m56.346002363s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387383688 (42h49m56.346480943s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387748522 (42h49m56.346845774s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388169432 (42h49m56.347266687s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388518528 (42h49m56.347615782s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388894089 (42h49m56.347991343s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389264527 (42h49m56.348361803s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389530288 (42h49m56.348627541s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389907245 (42h49m56.349004497s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.926564978 (42h49m56.885662209s) [upload=44626]: Next returned nil segment
Aug 10 12:15:34.926585943 (42h49m56.885683188s) [upload=44626]: Waiting for error group managing segments...
Aug 10 12:15:35.107788679 (42h49m57.066885917s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.108349025 (42h49m57.067446273s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.109118421 (42h49m57.068215657s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.117182262 (42h49m57.076279493s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129486809 (42h49m57.088584058s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129726897 (42h49m57.08882413s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131167259 (42h49m57.090264506s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131906506 (42h49m57.091003744s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134401397 (42h49m57.093498635s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134801233 (42h49m57.09389847s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.137397310 (42h49m57.096494549s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.150789559 (42h49m57.109886805s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.159186711 (42h49m57.118283949s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160841937 (42h49m57.119939185s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160864771 (42h49m57.119962018s) [seg_pos={0 0}, upload=44626]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:15:35.161010285 (42h49m57.12010753s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161311875 (42h49m57.120409121s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129pP9f3rFfTvP6MhG894N7WHuJRZP8aWhzJf1zBwZ76wbzVbZa): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161463897 (42h49m57.120561152s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx): protocol: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection
Aug 10 12:15:35.161548682 (42h49m57.120645928s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection
Aug 10 12:15:35.161564252 (42h49m57.120661507s) [seg_pos={0 0}, upload=44626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:15:35.161650866 (42h49m57.120748113s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:15:35.161657297 (42h49m57.120754555s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:15:35.370393179 (42h49m57.329490424s) [upload=44626]: Done uploading segments...
Aug 10 12:15:35.370413987 (42h49m57.329511225s) [upload=44626]: Upload finished. err: <nil>
Duration: 2.462430536s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
822.785533ms
FAIL (2025-08-10 12:19:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:00:27.338659164 (42h34m49.297756409s) [upload=44373]: Starting upload Aug 10 12:00:27.338723618 (42h34m49.297820862s) [upload=44373]: Done starting upload Aug 10 12:00:27.338803303 (42h34m49.29790054s) [upload=44373]: Uploading segments... Aug 10 12:00:27.338879179 (42h34m49.297976433s) [upload=44373]: Got next segment. Inline: true Aug 10 12:00:27.338885872 (42h34m49.297983117s) [upload=44373]: Waiting for error group managing segments... Aug 10 12:00:27.338933297 (42h34m49.298030543s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:00:27.338938463 (42h34m49.298035708s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 12:00:27.338942284 (42h34m49.29803953s) [upload=44373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 12:00:27.428036989 (42h34m49.387134224s) [upload=44373]: Done uploading segments... Aug 10 12:00:27.428055898 (42h34m49.387153144s) [upload=44373]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.900651ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.483691938s
FAIL (2025-08-10 12:18:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:15:34.181559613 (42h49m56.140656847s) [upload=44626]: Starting upload
Aug 10 12:15:34.181629530 (42h49m56.140726778s) [upload=44626]: Done starting upload
Aug 10 12:15:34.181725110 (42h49m56.140822342s) [upload=44626]: Uploading segments...
Aug 10 12:15:34.182085247 (42h49m56.141182517s) [upload=44626]: Got next segment. Inline: false
Aug 10 12:15:34.182152380 (42h49m56.141249625s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:15:34.182158726 (42h49m56.141255972s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:15:34.381948724 (42h49m56.341045968s) [seg_pos={0 0}, upload=44626]: Begin upload segment...
Aug 10 12:15:34.382014197 (42h49m56.341111431s) [seg_pos={0 0}, upload=44626]: Done begin upload segment.
Aug 10 12:15:34.382054116 (42h49m56.341151362s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382062995 (42h49m56.341160244s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382133334 (42h49m56.341230586s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382485100 (42h49m56.341582346s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382529057 (42h49m56.341626301s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.382807752 (42h49m56.341904997s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383089480 (42h49m56.342186729s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.383664074 (42h49m56.342761326s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386047065 (42h49m56.345144315s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.386905105 (42h49m56.346002363s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387383688 (42h49m56.346480943s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.387748522 (42h49m56.346845774s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388169432 (42h49m56.347266687s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388518528 (42h49m56.347615782s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.388894089 (42h49m56.347991343s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389264527 (42h49m56.348361803s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389530288 (42h49m56.348627541s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.389907245 (42h49m56.349004497s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Uploading piece...
Aug 10 12:15:34.926564978 (42h49m56.885662209s) [upload=44626]: Next returned nil segment
Aug 10 12:15:34.926585943 (42h49m56.885683188s) [upload=44626]: Waiting for error group managing segments...
Aug 10 12:15:35.107788679 (42h49m57.066885917s) [noise=true , address=104.36.82.39:4749 , piece_id=4NMPAT2PPSZIVIY4NGYWZUCHEUJM7WEEQT6AAKMSMC2BHQM6Y5LA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.108349025 (42h49m57.067446273s) [noise=true , address=104.36.82.19:4422 , piece_id=336SJRQC6CLPO2SWVV3R7SXNHYZKSX5242YQG72W7PZODGQX4FFA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.109118421 (42h49m57.068215657s) [noise=true , address=104.36.82.62:4416 , piece_id=JLV2XORSP3WWJLIRBYXBJR5TGEKPM6SLXNX34FBB436XM4U4WMPA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.117182262 (42h49m57.076279493s) [noise=true , address=104.36.82.37:4661 , piece_id=VXW4IWH6XUZQC7IGR7YCZMF4OSZBP3Q5IMUS62P6ASBCZYGTUBQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129486809 (42h49m57.088584058s) [noise=true , address=104.36.82.46:4498 , piece_id=JMUMY5A5SE2DTUUMLVNYG34ZYM34DQ5L5NF64HM6Q4UCRVHPDR4Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.129726897 (42h49m57.08882413s) [noise=true , address=104.36.82.23:4451 , piece_id=ALK4IVRR4G6XJ6VQFECON472NTHW2UCB5J4SJOLI5EBSYKJCG3LQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131167259 (42h49m57.090264506s) [noise=true , address=104.36.82.52:4104 , piece_id=5N3GHBFSL2PO2SPLGMAIFZIEU2ZTUK26QHNRWWUZ6NJLU6QYU2YA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.131906506 (42h49m57.091003744s) [noise=true , address=104.36.82.61:4377 , piece_id=GFOXXC7IXJUQCQ5AYKZITPDKQ4LF5C6ZYFHZMDAVN6T5EHXQ5Q6Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134401397 (42h49m57.093498635s) [noise=true , address=104.36.82.5:4849 , piece_id=ZJ5A2CJY5ISQ7EVHKQEF4XENDOCIW6X462N7BFCIV3O5O3AZWHKA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.134801233 (42h49m57.09389847s) [noise=true , address=104.36.82.58:4289 , piece_id=LNBFNO6KGLXSVBFNRAEFREX3SZFWQPCB7YM6AU5NUBLQ6E6NKZ4A, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.137397310 (42h49m57.096494549s) [noise=true , address=104.36.82.38:4710 , piece_id=FLEEVWQK5K3UXX2VUZYCTOXS4Z44P5XBB3J43OVOJPBYC6BDFJQA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.150789559 (42h49m57.109886805s) [noise=true , address=104.36.82.17:4338 , piece_id=2QW4HVYUJTNZVFKKZZ7456TAWIV6QZAJGSXRPYDV4Q5KACQ6WD5Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.159186711 (42h49m57.118283949s) [noise=true , address=104.36.82.60:4369 , piece_id=TW72GXPJBMOI2IMKGULUIZGC7AUBVTTWSZT6RYZSK7OVUFOW2EIA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160841937 (42h49m57.119939185s) [noise=true , address=104.36.82.36:4620 , piece_id=3XHGCGBTUQA7JCDMXFH44JOKRI34MAATNFIJWOZ5VGUL76OVH6BA, seg_pos={0 0}, upload=44626]: Done uploading piece. err: <nil>
Aug 10 12:15:35.160864771 (42h49m57.119962018s) [seg_pos={0 0}, upload=44626]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:15:35.161010285 (42h49m57.12010753s) [noise=true , address=104.36.82.45:4918 , piece_id=H3ZX52UNW4SKC7V4ZCVB372HB2PX5JT6FYJEFPHZ4S3CCLDSJG2Q, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Nw78dd9WPnmCwv5bFQR3VpV39776Pye2QVGSNMTs3zq2BtaGJ): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161311875 (42h49m57.120409121s) [noise=true , address=104.36.82.12:4179 , piece_id=JVX7LZVM4CRZBAYO3FJRTIQZKFCLFRNC5SRHKYJDSL6TTFCV22UQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129pP9f3rFfTvP6MhG894N7WHuJRZP8aWhzJf1zBwZ76wbzVbZa): protocol: expected piece hash; context canceled; EOF
Aug 10 12:15:35.161463897 (42h49m57.120561152s) [noise=true , address=193.149.164.143:4694 , piece_id=5UASMVU2ZSSL5ZOHQXAOWSO3LJPQNJJVUGOJEIDJXRELZTADDMZQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx): protocol: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48392->193.149.164.143:4694: use of closed network connection
Aug 10 12:15:35.161548682 (42h49m57.120645928s) [noise=true , address=64.49.13.140:4511 , piece_id=WUA7FRTSDMUKS2UZXUS5XMIK2RRAI7HABEKJFQ5QLE4PQV54OAKQ, seg_pos={0 0}, upload=44626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37874->64.49.13.140:4511: use of closed network connection
Aug 10 12:15:35.161564252 (42h49m57.120661507s) [seg_pos={0 0}, upload=44626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:15:35.161650866 (42h49m57.120748113s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:15:35.161657297 (42h49m57.120754555s) [upload=44626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:15:35.370393179 (42h49m57.329490424s) [upload=44626]: Done uploading segments...
Aug 10 12:15:35.370413987 (42h49m57.329511225s) [upload=44626]: Upload finished. err: <nil>
Duration: 2.483724257s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|