Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.142682307s
FAIL (2025-08-19 06:20:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.142715254s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.923666316s
FAIL (2025-08-19 06:20:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.923696678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
809.365098ms
FAIL (2025-08-19 06:19:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 809.395308ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.49440309s
FAIL (2025-08-19 06:19:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.494433942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
840.930916ms
FAIL (2025-08-19 06:18:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.036458ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.368028338s
FAIL (2025-08-19 06:18:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.368063751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
836.479129ms
FAIL (2025-08-19 06:18:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.507865ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.51717s
FAIL (2025-08-19 06:18:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.517212159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
913.886075ms
FAIL (2025-08-19 06:17:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 913.92347ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.303898186s
FAIL (2025-08-19 06:17:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.303934313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
802.943578ms
FAIL (2025-08-19 06:17:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 802.986052ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.473815429s
FAIL (2025-08-19 06:17:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.473854482s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
847.912005ms
FAIL (2025-08-19 06:16:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.021671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
847.616881ms
FAIL (2025-08-19 06:16:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.646592ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.382657196s
FAIL (2025-08-19 06:16:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.38268152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.474888609s
FAIL (2025-08-19 06:15:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.475002528s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.283843289s
FAIL (2025-08-19 06:15:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.283886822s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.320847865s
FAIL (2025-08-19 06:15:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.32088445s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
819.769255ms
FAIL (2025-08-19 06:15:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.846449ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.393827057s
FAIL (2025-08-19 06:14:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.393862965s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
807.035189ms
FAIL (2025-08-19 06:14:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 807.067535ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.747873057s
FAIL (2025-08-19 06:14:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.747969156s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.495599462s
FAIL (2025-08-19 06:14:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.495629948s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.03679499s
FAIL (2025-08-19 06:14:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.036846899s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.501938916s
FAIL (2025-08-19 06:14:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.50197502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.511252814s
FAIL (2025-08-19 06:14:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.51134564s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
800.942009ms
FAIL (2025-08-19 06:13:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 800.975664ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.652153542s
FAIL (2025-08-19 06:13:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.652252486s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
791.525728ms
FAIL (2025-08-19 06:13:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 791.555957ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.351878609s
FAIL (2025-08-19 06:13:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.351914848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.702534069s
FAIL (2025-08-19 06:13:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.702571261s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
365.410911ms
FAIL (2025-08-19 06:12:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 365.436503ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.516445513s
FAIL (2025-08-19 06:11:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.51663833s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.479595023s
FAIL (2025-08-19 06:11:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.479631455s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.658243598s
FAIL (2025-08-19 06:10:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.658283088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.523020698s
FAIL (2025-08-19 06:10:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.52305576s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.638091852s
FAIL (2025-08-19 06:10:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.638130262s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.598288447s
FAIL (2025-08-19 06:09:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.598322892s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.776930815s
FAIL (2025-08-19 06:09:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.776965878s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X............................X..............................] duration:
2.456145566s
FAIL (2025-08-19 06:09:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.456203903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.45311628s
FAIL (2025-08-19 06:08:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.453152189s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X............................X.............................] duration:
2.688644144s
FAIL (2025-08-19 06:08:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.688674039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.369014179s
FAIL (2025-08-19 06:08:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.369046194s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X............................X............................] duration:
2.475302681s
FAIL (2025-08-19 06:07:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.475336349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X............................X...........................] duration:
2.458846571s
FAIL (2025-08-19 06:07:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.458873533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.292113228s
FAIL (2025-08-19 06:07:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.292155022s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X............................X..........................] duration:
2.325277203s
FAIL (2025-08-19 06:06:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.325315453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X............................X.........................] duration:
2.649166058s
FAIL (2025-08-19 06:06:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.649205247s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.612580554s
FAIL (2025-08-19 06:06:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
tch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:31:09.160750281 (252h5m31.119847534s) [seg_pos={0 0}, upload=262407]: Begin upload segment...
Aug 19 05:31:09.160971718 (252h5m31.120068973s) [seg_pos={0 0}, upload=262407]: Done begin upload segment.
Aug 19 05:31:09.161000518 (252h5m31.120097791s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161037226 (252h5m31.120134482s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161363756 (252h5m31.120461004s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161491312 (252h5m31.120588569s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161601191 (252h5m31.120698439s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.161986567 (252h5m31.121083823s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162485668 (252h5m31.121582925s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162580843 (252h5m31.121678088s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.162922909 (252h5m31.122020144s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163394819 (252h5m31.122492075s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163857697 (252h5m31.122954981s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.163966849 (252h5m31.1230641s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164396684 (252h5m31.123493929s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164767135 (252h5m31.123864404s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.164952168 (252h5m31.124049419s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165259231 (252h5m31.124356476s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165550483 (252h5m31.124647732s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.165855608 (252h5m31.12495286s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Uploading piece...
Aug 19 05:31:09.724928042 (252h5m31.684025274s) [upload=262407]: Next returned nil segment
Aug 19 05:31:09.724953246 (252h5m31.684050498s) [upload=262407]: Waiting for error group managing segments...
Aug 19 05:31:09.862320322 (252h5m31.821417554s) [noise=true , address=77.90.31.17:4800 , piece_id=MYNIZXQ7IF2PXTP42TB5YMBTFSWQGGWSV6UPZVRAEBCI2JYPA52Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872240686 (252h5m31.831337931s) [noise=true , address=45.91.116.14:4208 , piece_id=J6J5WGNESS6M34CCACYGBOARY7HWG3ZDPVR2VELNGMQY6QOFFEIQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.872851964 (252h5m31.831949196s) [noise=true , address=45.91.116.8:4075 , piece_id=ENTA4NO367QG25FELURW3HPA7K5HLOLQQIGTJRH5S3UIY5HRTFEQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.875976361 (252h5m31.835073593s) [noise=true , address=77.90.31.18:4835 , piece_id=LTC2IXDOPUEZ2M5ZT4C6BLQX6ALKL56LHEEBLW6ZH6VEZSVYXW3Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.876882333 (252h5m31.835979565s) [noise=true , address=45.91.116.13:4157 , piece_id=LYDMUC2AYNV7HP55ZK2OVK3GOMSYZYXWMP6K32ZZTUUPB4EZGCRQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.884712677 (252h5m31.843809915s) [noise=true , address=77.90.31.21:4891 , piece_id=7O4KDALX443QZL7YJA2DTWBVAKARRANVS2V4FY4W3CUNGLM4HCUA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.891405278 (252h5m31.850502517s) [noise=true , address=104.36.82.5:4851 , piece_id=WHD5QFWWXGJS64QUVYVSWXS4CANUI2UWFXX5RAMQAVDMKDTI4PKA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.898131837 (252h5m31.857229088s) [noise=true , address=104.36.82.18:4383 , piece_id=5HUZPO5STST2NL4JYCTLI7OXWXZE7KBZP5YQ42IOKT3MRFQ73TMQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.906811928 (252h5m31.86590917s) [noise=true , address=77.90.31.12:4597 , piece_id=KQ6AWPJZMM2FYRQMADBYZZWRVETYJ25JABEPRZ37NIS6OCFOVYAA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.908401497 (252h5m31.867498732s) [noise=true , address=77.90.31.15:4716 , piece_id=2IIEEOXHLMFBWG6MHLMI6EWPBAVHLPJU2B432ZWIDOZRUNHLB7ZQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.918039103 (252h5m31.877136348s) [noise=true , address=79.127.219.38:4027 , piece_id=TRNJ2HGUVSCGU3FXSR56TL4HIL2G26HC7FYZLEMVXAAPNOP4LM2A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.922850494 (252h5m31.881947729s) [noise=true , address=104.36.82.23:4479 , piece_id=FJA7K7DK27REXC4BSZC665FVYFPC5D26W46JAFQTPVJEOZTBXV7Q, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.926724666 (252h5m31.885821911s) [noise=true , address=77.90.31.10:4545 , piece_id=CCKVA6KBA3NU6XOGNGBUB7VBOY4SZ2PTFOJIZHKUAGFK57SPZGLQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929511131 (252h5m31.88860837s) [noise=true , address=77.90.31.16:4768 , piece_id=T3LLSCRRGDV7NBQTE34IFTNDVOGKTVG4OPBNFCBHJIPBHE2WQ5KQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: <nil>
Aug 19 05:31:09.929538743 (252h5m31.888635989s) [seg_pos={0 0}, upload=262407]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:31:09.929753393 (252h5m31.888850645s) [noise=true , address=104.36.82.60:4361 , piece_id=DLYNIBYS4JS3YE7XIDYNZCR3CEDVQQVSJHDWKPO35JPKNFIJDVFA, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929770782 (252h5m31.888868027s) [noise=true , address=79.127.219.51:4200 , piece_id=SOULRZY2IO3ZEGPPQPYUU2I2FDOHPLL2R2RFIORSWZAGSLOF7N6A, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AuCU2sM7dKAfjqtkVimnAQk6qkQERoQPTHwxAV9FPcrfM3TTK): protocol: expected piece hash; context canceled; EOF
Aug 19 05:31:09.929851926 (252h5m31.888949175s) [noise=true , address=79.127.205.246:4264 , piece_id=62GYCGGTHINTY5W3KC2K7QWODVWFF655SW3TOL74X6ZVRZAQ5HXQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34298->79.127.205.246:4264: use of closed network connection
Aug 19 05:31:09.930129954 (252h5m31.889227189s) [noise=true , address=66.23.193.175:4556 , piece_id=HJDSYOMCS4RCJBRGOAPU2NJDHBQUY6BVGEWJBGYLIKJRWGQ33JKQ, seg_pos={0 0}, upload=262407]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47910->66.23.193.175:4556: use of closed network connection
Aug 19 05:31:09.930148564 (252h5m31.8892458s) [seg_pos={0 0}, upload=262407]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:31:09.930248569 (252h5m31.889345824s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:31:09.930269816 (252h5m31.889367062s) [upload=262407]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:33:45.505590662 (252h8m7.464687897s) [upload=262407]: Done uploading segments...
Aug 19 05:33:45.505612739 (252h8m7.464709975s) [upload=262407]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.612617196s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X............................X........................] duration:
2.491602205s
FAIL (2025-08-19 06:05:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.491636043s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|