Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.........X.............X.....................] duration: 2.895449599s FAIL (2025-08-07 11:31:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.895487423s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 868.336373ms FAIL (2025-08-07 11:30:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 868.360937ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.........X.............X....................] duration: 2.458412351s FAIL (2025-08-07 11:30:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.458444718s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X.........X.............X...................] duration: 2.783917651s FAIL (2025-08-07 11:30:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.783951378s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 888.12646ms FAIL (2025-08-07 11:29:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 888.156759ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X.........X.............X..................] duration: 2.656876441s FAIL (2025-08-07 11:29:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.656908055s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 835.394181ms FAIL (2025-08-07 11:29:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 835.423134ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X.........X.............X.................] duration: 2.388535715s FAIL (2025-08-07 11:28:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.388594979s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 867.852563ms FAIL (2025-08-07 11:28:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 867.941287ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 857.415941ms FAIL (2025-08-07 11:27:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 857.514218ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X.........X.............X................] duration: 2.330036811s FAIL (2025-08-07 11:27:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.330069045s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 823.79887ms FAIL (2025-08-07 11:27:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 823.824398ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X.........X.............X...............] duration: 2.334760441s FAIL (2025-08-07 11:26:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.3347892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 891.857684ms FAIL (2025-08-07 11:26:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 891.890457ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 853.941859ms FAIL (2025-08-07 11:26:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 853.963852ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.........X.............X..............] duration: 2.418825743s FAIL (2025-08-07 11:26:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.418868758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X.........X.............X.............] duration: 2.685481103s FAIL (2025-08-07 11:26:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.68551609s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 902.849354ms FAIL (2025-08-07 11:25:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 902.871318ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.........X.............X............] duration: 2.382179107s FAIL (2025-08-07 11:24:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.382224069s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X.........X.............X...........] duration: 2.47799818s FAIL (2025-08-07 11:24:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.478034145s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 856.934743ms FAIL (2025-08-07 11:24:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 857.045687ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 856.99913ms FAIL (2025-08-07 11:23:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 857.062251ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.........X.............X..........] duration: 2.404211261s FAIL (2025-08-07 11:23:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.404270453s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 861.671063ms FAIL (2025-08-07 11:23:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 861.702486ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.........X.............X.........] duration: 2.438918907s FAIL (2025-08-07 11:22:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.438955016s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 844.77022ms FAIL (2025-08-07 11:21:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 844.821707ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.........X.............X........] duration: 2.332336923s FAIL (2025-08-07 11:21:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.332368595s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X.........X.............X.......] duration: 2.321795562s FAIL (2025-08-07 11:21:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.321977557s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 985.358044ms FAIL (2025-08-07 11:21:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 985.390744ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.........X.............X......] duration: 2.384574347s FAIL (2025-08-07 11:20:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.384603754s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 845.536699ms FAIL (2025-08-07 11:20:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 845.567522ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.........X.............X.....] duration: 2.39571557s FAIL (2025-08-07 11:20:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.395757458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 851.411796ms FAIL (2025-08-07 11:19:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 851.441253ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.........X.............X....] duration: 2.448312674s FAIL (2025-08-07 11:18:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.448346738s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 858.922877ms FAIL (2025-08-07 11:18:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 858.954408ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X.........X.............X...] duration: 2.402067063s FAIL (2025-08-07 11:17:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.402095677s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 849.826999ms FAIL (2025-08-07 11:17:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 849.962004ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.081237873s FAIL (2025-08-07 11:17:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 1.081333678s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.........X.............X..] duration: 2.373434851s FAIL (2025-08-07 11:16:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.373467102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 848.755833ms FAIL (2025-08-07 11:16:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 848.786204ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.........X.............X.] duration: 2.341645395s FAIL (2025-08-07 11:16:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 2.341673817s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.........X.............X] duration: 1.655554191s FAIL (2025-08-07 11:15:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== d=1658]: Got next segment. Inline: false Aug 7 11:15:44.406708026 (1h36m6.150764877s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:15:44.406713680 (1h36m6.150770544s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:15:44.613545729 (1h36m6.357602589s) [seg_pos={0 0}, upload=1658]: Begin upload segment... Aug 7 11:15:44.613620454 (1h36m6.357677321s) [seg_pos={0 0}, upload=1658]: Done begin upload segment. Aug 7 11:15:44.613630294 (1h36m6.357687163s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.613650875 (1h36m6.357707745s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614212288 (1h36m6.358269156s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614537136 (1h36m6.358593996s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.614806078 (1h36m6.358862937s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615062766 (1h36m6.359119627s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615339311 (1h36m6.359396157s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.615752645 (1h36m6.359809504s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616103532 (1h36m6.360160403s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616471079 (1h36m6.360527942s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616800071 (1h36m6.360856942s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.616984818 (1h36m6.361041682s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617328089 (1h36m6.36138496s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.617675379 (1h36m6.361732243s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618006425 (1h36m6.362063291s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618329242 (1h36m6.362386102s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618656415 (1h36m6.362713282s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:44.618795520 (1h36m6.36285238s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Uploading piece... Aug 7 11:15:45.199803427 (1h36m6.943860288s) [upload=1658]: Next returned nil segment Aug 7 11:15:45.199826870 (1h36m6.943883749s) [upload=1658]: Waiting for error group managing segments... Aug 7 11:15:45.348962677 (1h36m7.093019528s) [noise=true , address=104.36.82.61:4394 , piece_id=K6QY5YFY7JIPF66DP5ZW76FK2CQU5HNPP5IKRTF6XPKNTSMZAWFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.349552901 (1h36m7.093609764s) [noise=true , address=104.36.82.9:4040 , piece_id=RLL5JC64BSX2HGISVNZIGGVK56JPTCM22JUPGUIV7CBIRUTWSBLQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.353175278 (1h36m7.097232128s) [noise=true , address=104.36.82.43:4841 , piece_id=GWQS7NJD5YAIA7V27JZT5XCOU4EU3PNMIXWACXAM5SYCPPY6I37Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.356539925 (1h36m7.100596787s) [noise=true , address=45.91.116.11:4129 , piece_id=I2KM4TJECGYZW5TCHQZ3UOMCMDOHM7GTZARPAR3YQ2LRZ45W6KAQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365380799 (1h36m7.109437651s) [noise=true , address=104.36.82.43:4865 , piece_id=Z6IFPTMZCPFG4WT6JRRT23K6TMEWYNXWA2MRA3PKEVAAURR3XDTA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.365492148 (1h36m7.109549s) [noise=true , address=104.36.82.23:4449 , piece_id=A62P6PUREPP23ZHMUMH3RWUQMFVRIKUMTH4TXMQN5WS5WTXNZEIQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.366343600 (1h36m7.110400454s) [noise=true , address=45.91.116.10:4087 , piece_id=AF6V4TDDIWIRRSHSBW4NA3R4KQYOIUR4DXBVIJHWM3NGQRRI7EMQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.373722286 (1h36m7.117779139s) [noise=true , address=104.36.82.45:4917 , piece_id=5EUVD5A6IBZTNRSYT7MVADAPD7CWADXSYPXTD5K52I5FIAAAP4NA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377155741 (1h36m7.121212587s) [noise=true , address=104.36.82.4:4808 , piece_id=JXSAQLOANSFEKBPZGASA35SPQHV4UQN7RNAXF6UGEPGX3MJKBDGQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.377554382 (1h36m7.121611232s) [noise=true , address=104.36.82.2:4759 , piece_id=Y4EI72YKCCGOYF47BLCLCSEZWOFZMYWCBKWLM65T3L3IL6GMG2FA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.387241223 (1h36m7.13129807s) [noise=true , address=104.36.82.13:4215 , piece_id=4YCARYS7OOH75RALLXKILNKJ6N66UU42HYBHUGLXYEL4FS2YXYGA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.388312144 (1h36m7.132369008s) [noise=true , address=104.36.82.37:4665 , piece_id=ACOACV3LSHV5DCRXZXNM3C5N6IA5ZNH5H7T5LV5APQJY7FHOQYEQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.394483821 (1h36m7.138540674s) [noise=true , address=104.36.82.62:4431 , piece_id=5KVJN4RKZ72MX3QECQO5FAOBPJ2FOP5JVZ5AG6ZB22SGUCRECKFA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.401983383 (1h36m7.146040229s) [noise=true , address=104.36.82.19:4422 , piece_id=4HIXTGCP7ZC7HTZWVTWY6NJ6EJQM65ZTVRK277JUXGTZADJLJQ6A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: <nil> Aug 7 11:15:45.402027586 (1h36m7.146084448s) [seg_pos={0 0}, upload=1658]: Segment reached optimal threshold of 14 pieces. Aug 7 11:15:45.402472120 (1h36m7.146528989s) [noise=true , address=104.36.82.44:4876 , piece_id=MHGEXHJUAC47DXRXZ4ZO2KWAN7XR6ORGSQXGGWTRT7DIWZNGAT3Q, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402911431 (1h36m7.146968292s) [noise=true , address=64.49.13.170:4726 , piece_id=LTMZX6NVWKQPXKT3IG5A4G6IPVA5ZCQINOXDXM2KMA5DNMH35AUA, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58568->64.49.13.170:4726: use of closed network connection Aug 7 11:15:45.402936088 (1h36m7.146992945s) [noise=true , address=104.36.82.60:4348 , piece_id=2WXX6BA4VQS6L2UEZX4FYCZE2MTPIIJTSTSCFYU5S46PWBPBBIZQ, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ezboNAWPbaK9UDENYoBb3iHjNU2ahn7mikiteN7y3Aj6uw4Nx): protocol: expected piece hash; context canceled; EOF Aug 7 11:15:45.402971815 (1h36m7.147028666s) [noise=true , address=64.49.13.139:4474 , piece_id=Y6HUDHRCA2MKDT2M5PVYM223GYDYR3MMYDBDBXQV74IEWJ7T724A, seg_pos={0 0}, upload=1658]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46214->64.49.13.139:4474: use of closed network connection Aug 7 11:15:45.403003073 (1h36m7.14705992s) [seg_pos={0 0}, upload=1658]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:15:45.403119046 (1h36m7.147175908s) [upload=1658]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:15:45.403125128 (1h36m7.147181992s) [upload=1658]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:15:45.564186671 (1h36m7.308243542s) [upload=1658]: Done uploading segments... Aug 7 11:15:45.564210625 (1h36m7.308267486s) [upload=1658]: Upload finished. err: <nil> Duration: 1.655581623s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 943.44644ms FAIL (2025-08-07 11:15:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 943.47531ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.........X.............] duration: 2.380684708s FAIL (2025-08-07 11:15:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 36b2ad92ea56f1f9efb821b962619a219383ba7f083ef4bd288f823ef5326077 != before 371e9d6ecc0d5cc09d9fd0b7b7dd37e98901cffba8439ee4ac3bdae1e79f3956 ======LOGS====== ne: false Aug 7 11:05:03.841707452 (1h25m25.585764302s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:05:03.841737932 (1h25m25.585794806s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:05:04.047393151 (1h25m25.791450025s) [seg_pos={0 0}, upload=1475]: Begin upload segment... Aug 7 11:05:04.047458572 (1h25m25.791515443s) [seg_pos={0 0}, upload=1475]: Done begin upload segment. Aug 7 11:05:04.047494536 (1h25m25.791551408s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048090266 (1h25m25.792147134s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048517165 (1h25m25.792574036s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048918550 (1h25m25.792975419s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049324837 (1h25m25.793381711s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049713832 (1h25m25.793770708s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.051471616 (1h25m25.79552849s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.054423471 (1h25m25.798480348s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055198530 (1h25m25.799255403s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055892404 (1h25m25.799949286s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.056515773 (1h25m25.80057265s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057105107 (1h25m25.801161979s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057741583 (1h25m25.801798463s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.058361767 (1h25m25.802418644s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.059970813 (1h25m25.804027681s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.060680228 (1h25m25.804737091s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.061339686 (1h25m25.80539656s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.062118178 (1h25m25.806175052s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.635405418 (1h25m26.37946228s) [upload=1475]: Next returned nil segment Aug 7 11:05:04.635431924 (1h25m26.379488792s) [upload=1475]: Waiting for error group managing segments... Aug 7 11:05:04.802087463 (1h25m26.546144331s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.803348134 (1h25m26.547404982s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.804599262 (1h25m26.54865611s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.805258850 (1h25m26.549315725s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.810948217 (1h25m26.555005064s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.820364382 (1h25m26.56442123s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.821002401 (1h25m26.565059264s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.824588270 (1h25m26.568645126s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.833061313 (1h25m26.577118178s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.836390561 (1h25m26.580447414s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.850689867 (1h25m26.594746718s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.852813350 (1h25m26.596870215s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.854702553 (1h25m26.598759419s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910354972 (1h25m26.654411823s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910378131 (1h25m26.654434984s) [seg_pos={0 0}, upload=1475]: Segment reached optimal threshold of 14 pieces. Aug 7 11:05:04.910622661 (1h25m26.654679521s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gn31FU1BnbHPLvB7k1RZhtJbDdJCLyBLa5A6VhDNMFN7erSG1): protocol: expected piece hash; context canceled; EOF Aug 7 11:05:04.910745526 (1h25m26.654802398s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection Aug 7 11:05:04.910807757 (1h25m26.654864618s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQqzHsTJvR5wHpEGXDixk3NcRuBKxY2cL82eJMHidcxFiPCZb): protocol: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection Aug 7 11:05:04.910948613 (1h25m26.655005474s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): internal: context canceled Aug 7 11:05:04.910972851 (1h25m26.655029714s) [seg_pos={0 0}, upload=1475]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:05:04.911078579 (1h25m26.655135451s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:05:04.911085260 (1h25m26.655142129s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:05.073578299 (1h25m26.817635168s) [upload=1475]: Done uploading segments... Aug 7 11:05:05.073604973 (1h25m26.817661841s) [upload=1475]: Upload finished. err: <nil> Duration: 2.380722238s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 873.138338ms FAIL (2025-08-07 11:15:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 873.229281ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.........X............] duration: 2.543752484s FAIL (2025-08-07 11:15:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 36b2ad92ea56f1f9efb821b962619a219383ba7f083ef4bd288f823ef5326077 != before 371e9d6ecc0d5cc09d9fd0b7b7dd37e98901cffba8439ee4ac3bdae1e79f3956 ======LOGS====== ne: false Aug 7 11:05:03.841707452 (1h25m25.585764302s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:05:03.841737932 (1h25m25.585794806s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:05:04.047393151 (1h25m25.791450025s) [seg_pos={0 0}, upload=1475]: Begin upload segment... Aug 7 11:05:04.047458572 (1h25m25.791515443s) [seg_pos={0 0}, upload=1475]: Done begin upload segment. Aug 7 11:05:04.047494536 (1h25m25.791551408s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048090266 (1h25m25.792147134s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048517165 (1h25m25.792574036s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048918550 (1h25m25.792975419s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049324837 (1h25m25.793381711s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049713832 (1h25m25.793770708s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.051471616 (1h25m25.79552849s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.054423471 (1h25m25.798480348s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055198530 (1h25m25.799255403s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055892404 (1h25m25.799949286s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.056515773 (1h25m25.80057265s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057105107 (1h25m25.801161979s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057741583 (1h25m25.801798463s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.058361767 (1h25m25.802418644s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.059970813 (1h25m25.804027681s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.060680228 (1h25m25.804737091s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.061339686 (1h25m25.80539656s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.062118178 (1h25m25.806175052s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.635405418 (1h25m26.37946228s) [upload=1475]: Next returned nil segment Aug 7 11:05:04.635431924 (1h25m26.379488792s) [upload=1475]: Waiting for error group managing segments... Aug 7 11:05:04.802087463 (1h25m26.546144331s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.803348134 (1h25m26.547404982s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.804599262 (1h25m26.54865611s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.805258850 (1h25m26.549315725s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.810948217 (1h25m26.555005064s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.820364382 (1h25m26.56442123s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.821002401 (1h25m26.565059264s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.824588270 (1h25m26.568645126s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.833061313 (1h25m26.577118178s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.836390561 (1h25m26.580447414s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.850689867 (1h25m26.594746718s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.852813350 (1h25m26.596870215s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.854702553 (1h25m26.598759419s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910354972 (1h25m26.654411823s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910378131 (1h25m26.654434984s) [seg_pos={0 0}, upload=1475]: Segment reached optimal threshold of 14 pieces. Aug 7 11:05:04.910622661 (1h25m26.654679521s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gn31FU1BnbHPLvB7k1RZhtJbDdJCLyBLa5A6VhDNMFN7erSG1): protocol: expected piece hash; context canceled; EOF Aug 7 11:05:04.910745526 (1h25m26.654802398s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection Aug 7 11:05:04.910807757 (1h25m26.654864618s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQqzHsTJvR5wHpEGXDixk3NcRuBKxY2cL82eJMHidcxFiPCZb): protocol: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection Aug 7 11:05:04.910948613 (1h25m26.655005474s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): internal: context canceled Aug 7 11:05:04.910972851 (1h25m26.655029714s) [seg_pos={0 0}, upload=1475]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:05:04.911078579 (1h25m26.655135451s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:05:04.911085260 (1h25m26.655142129s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:05.073578299 (1h25m26.817635168s) [upload=1475]: Done uploading segments... Aug 7 11:05:05.073604973 (1h25m26.817661841s) [upload=1475]: Upload finished. err: <nil> Duration: 2.543785233s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.............................................X.............] duration: 816.074369ms FAIL (2025-08-07 11:14:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 816.110565ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.........X...........] duration: 2.375519371s FAIL (2025-08-07 11:13:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 36b2ad92ea56f1f9efb821b962619a219383ba7f083ef4bd288f823ef5326077 != before 371e9d6ecc0d5cc09d9fd0b7b7dd37e98901cffba8439ee4ac3bdae1e79f3956 ======LOGS====== ne: false Aug 7 11:05:03.841707452 (1h25m25.585764302s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:05:03.841737932 (1h25m25.585794806s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:05:04.047393151 (1h25m25.791450025s) [seg_pos={0 0}, upload=1475]: Begin upload segment... Aug 7 11:05:04.047458572 (1h25m25.791515443s) [seg_pos={0 0}, upload=1475]: Done begin upload segment. Aug 7 11:05:04.047494536 (1h25m25.791551408s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048090266 (1h25m25.792147134s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048517165 (1h25m25.792574036s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048918550 (1h25m25.792975419s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049324837 (1h25m25.793381711s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049713832 (1h25m25.793770708s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.051471616 (1h25m25.79552849s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.054423471 (1h25m25.798480348s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055198530 (1h25m25.799255403s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055892404 (1h25m25.799949286s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.056515773 (1h25m25.80057265s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057105107 (1h25m25.801161979s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057741583 (1h25m25.801798463s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.058361767 (1h25m25.802418644s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.059970813 (1h25m25.804027681s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.060680228 (1h25m25.804737091s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.061339686 (1h25m25.80539656s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.062118178 (1h25m25.806175052s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.635405418 (1h25m26.37946228s) [upload=1475]: Next returned nil segment Aug 7 11:05:04.635431924 (1h25m26.379488792s) [upload=1475]: Waiting for error group managing segments... Aug 7 11:05:04.802087463 (1h25m26.546144331s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.803348134 (1h25m26.547404982s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.804599262 (1h25m26.54865611s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.805258850 (1h25m26.549315725s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.810948217 (1h25m26.555005064s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.820364382 (1h25m26.56442123s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.821002401 (1h25m26.565059264s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.824588270 (1h25m26.568645126s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.833061313 (1h25m26.577118178s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.836390561 (1h25m26.580447414s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.850689867 (1h25m26.594746718s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.852813350 (1h25m26.596870215s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.854702553 (1h25m26.598759419s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910354972 (1h25m26.654411823s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910378131 (1h25m26.654434984s) [seg_pos={0 0}, upload=1475]: Segment reached optimal threshold of 14 pieces. Aug 7 11:05:04.910622661 (1h25m26.654679521s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gn31FU1BnbHPLvB7k1RZhtJbDdJCLyBLa5A6VhDNMFN7erSG1): protocol: expected piece hash; context canceled; EOF Aug 7 11:05:04.910745526 (1h25m26.654802398s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection Aug 7 11:05:04.910807757 (1h25m26.654864618s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQqzHsTJvR5wHpEGXDixk3NcRuBKxY2cL82eJMHidcxFiPCZb): protocol: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection Aug 7 11:05:04.910948613 (1h25m26.655005474s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): internal: context canceled Aug 7 11:05:04.910972851 (1h25m26.655029714s) [seg_pos={0 0}, upload=1475]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:05:04.911078579 (1h25m26.655135451s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:05:04.911085260 (1h25m26.655142129s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:05.073578299 (1h25m26.817635168s) [upload=1475]: Done uploading segments... Aug 7 11:05:05.073604973 (1h25m26.817661841s) [upload=1475]: Upload finished. err: <nil> Duration: 2.375552645s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.........X..........] duration: 2.84352768s FAIL (2025-08-07 11:13:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 36b2ad92ea56f1f9efb821b962619a219383ba7f083ef4bd288f823ef5326077 != before 371e9d6ecc0d5cc09d9fd0b7b7dd37e98901cffba8439ee4ac3bdae1e79f3956 ======LOGS====== ne: false Aug 7 11:05:03.841707452 (1h25m25.585764302s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:05:03.841737932 (1h25m25.585794806s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:05:04.047393151 (1h25m25.791450025s) [seg_pos={0 0}, upload=1475]: Begin upload segment... Aug 7 11:05:04.047458572 (1h25m25.791515443s) [seg_pos={0 0}, upload=1475]: Done begin upload segment. Aug 7 11:05:04.047494536 (1h25m25.791551408s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048090266 (1h25m25.792147134s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048517165 (1h25m25.792574036s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.048918550 (1h25m25.792975419s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049324837 (1h25m25.793381711s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.049713832 (1h25m25.793770708s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.051471616 (1h25m25.79552849s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.054423471 (1h25m25.798480348s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055198530 (1h25m25.799255403s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.055892404 (1h25m25.799949286s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.056515773 (1h25m25.80057265s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057105107 (1h25m25.801161979s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.057741583 (1h25m25.801798463s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.058361767 (1h25m25.802418644s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.059970813 (1h25m25.804027681s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.060680228 (1h25m25.804737091s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.061339686 (1h25m25.80539656s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.062118178 (1h25m25.806175052s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Uploading piece... Aug 7 11:05:04.635405418 (1h25m26.37946228s) [upload=1475]: Next returned nil segment Aug 7 11:05:04.635431924 (1h25m26.379488792s) [upload=1475]: Waiting for error group managing segments... Aug 7 11:05:04.802087463 (1h25m26.546144331s) [noise=true , address=45.91.116.8:4061 , piece_id=LQW2NAVQX2KEBILWD254XBI3KFKAD5SCHOB2BWWVEONSLWOD5D4Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.803348134 (1h25m26.547404982s) [noise=true , address=104.36.82.14:4252 , piece_id=UW4PSTURIIH6XSN7454TYHH3TSUWBIBSZPPCZTFDNOY6VNYPCVSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.804599262 (1h25m26.54865611s) [noise=true , address=104.36.82.23:4449 , piece_id=MFAEGBP5NJQKH4YYRAR5Z3CY7QPILKIBIWT2C77EWVIV4LOFHNGQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.805258850 (1h25m26.549315725s) [noise=true , address=104.36.82.43:4850 , piece_id=XD4BUD3X7E7WLQMP2NV6HEIBD473PJTNQKAEQKLDEPM5ST5ZP24Q, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.810948217 (1h25m26.555005064s) [noise=true , address=45.91.116.11:4150 , piece_id=ZTXKYQLHGQXCEYAKGPCRWAJ6NVBN6BDTBVOCJSRU3AFBIMSNZVPQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.820364382 (1h25m26.56442123s) [noise=true , address=104.36.82.45:4909 , piece_id=PF3I6XYLAX4KW5WLPVNLO625PEHKHEC6RGHFYJ3JGMEEB2CAFGAA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.821002401 (1h25m26.565059264s) [noise=true , address=104.36.82.62:4418 , piece_id=DY7AIHB7Z2G3AUB5UXGO7S5FCZFMURP25IW3UIHQSVCANLSKROKA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.824588270 (1h25m26.568645126s) [noise=true , address=104.36.82.59:4323 , piece_id=ZH4NYTJE4ZQ2LRAPZYWIP55VIKZOLPAC3J7CDHP6QMAKLP6PRQNA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.833061313 (1h25m26.577118178s) [noise=true , address=104.36.82.13:4189 , piece_id=5HTS6XDOTK6SYXGUMDEEHCI34SKIIFCKMNX5KSJIBLMQIXBRSDPA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.836390561 (1h25m26.580447414s) [noise=true , address=104.36.82.60:4371 , piece_id=4WISPN5R5NOJ7F5LSNS5NLRISW7XLIX3H6QP5T7WZ4BZZCORXH4A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.850689867 (1h25m26.594746718s) [noise=true , address=104.36.82.47:4536 , piece_id=U7HAJZQZRFXGWINY4LHV3E32AM62AB6CE253TMOXSCHKBX7B37WA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.852813350 (1h25m26.596870215s) [noise=true , address=104.36.82.41:4773 , piece_id=LZZ4KCR5EBUAADDYATOMJFCGBKHRASSDHQMLE2UWMHB6E4P6WOMA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.854702553 (1h25m26.598759419s) [noise=true , address=104.36.82.58:4292 , piece_id=MLQCZHBORMOG6AHHOZCPCPEJQ2VFXWD25YIHITAXXQPGYQ2II7KA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910354972 (1h25m26.654411823s) [noise=true , address=104.36.82.46:4516 , piece_id=VICVOZLSYD44GLMWNWRIBN4IWSUXAOOA4D4J3RTEI4IOKA36MUWA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: <nil> Aug 7 11:05:04.910378131 (1h25m26.654434984s) [seg_pos={0 0}, upload=1475]: Segment reached optimal threshold of 14 pieces. Aug 7 11:05:04.910622661 (1h25m26.654679521s) [noise=true , address=104.36.82.58:4291 , piece_id=UCPW7QMT42WDINUGKB6BNJGKUKJFFVVSSVQ75GEKSXR3HPCZGOIA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gn31FU1BnbHPLvB7k1RZhtJbDdJCLyBLa5A6VhDNMFN7erSG1): protocol: expected piece hash; context canceled; EOF Aug 7 11:05:04.910745526 (1h25m26.654802398s) [noise=true , address=193.149.164.143:4699 , piece_id=6X3QQJ6FQENU2VG4MHR7BH4GQNIRFIHMAK2REQ6G334MUI24HHKQ, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35976->193.149.164.143:4699: use of closed network connection Aug 7 11:05:04.910807757 (1h25m26.654864618s) [noise=true , address=64.49.13.138:4488 , piece_id=W75R7HIHFZHPDIUBGQ23U2ZVHEOKLYTYYBXXW6BG2JKPKE6URXSA, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQqzHsTJvR5wHpEGXDixk3NcRuBKxY2cL82eJMHidcxFiPCZb): protocol: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59142->64.49.13.138:4488: use of closed network connection Aug 7 11:05:04.910948613 (1h25m26.655005474s) [noise=true , address=193.149.164.143:4698 , piece_id=6245DFH6U3F42CBJRJIQ3WR3XNOTHQ44SBAZ2L4RZSDWCGTWGJ5A, seg_pos={0 0}, upload=1475]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): internal: context canceled Aug 7 11:05:04.910972851 (1h25m26.655029714s) [seg_pos={0 0}, upload=1475]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:05:04.911078579 (1h25m26.655135451s) [upload=1475]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:05:04.911085260 (1h25m26.655142129s) [upload=1475]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:05.073578299 (1h25m26.817635168s) [upload=1475]: Done uploading segments... Aug 7 11:05:05.073604973 (1h25m26.817661841s) [upload=1475]: Upload finished. err: <nil> Duration: 2.843554488s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X.............................................X............] duration: 921.354021ms FAIL (2025-08-07 11:13:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 10:57:26.461116710 (1h17m48.205173626s) [upload=1342]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:26.636344014 (1h17m48.380400865s) [upload=1342]: Done uploading segments... Aug 7 10:57:26.636361354 (1h17m48.380418204s) [upload=1342]: Upload finished. err: <nil> Aug 7 10:58:24.003502715 (1h18m45.747559579s) [upload=1357]: Starting upload Aug 7 10:58:24.003592365 (1h18m45.747649227s) [upload=1357]: Done starting upload Aug 7 10:58:24.003803084 (1h18m45.747859939s) [upload=1357]: Uploading segments... Aug 7 10:58:24.003964519 (1h18m45.74802139s) [upload=1357]: Got next segment. Inline: true Aug 7 10:58:24.003977317 (1h18m45.748034193s) [upload=1357]: Waiting for error group managing segments... Aug 7 10:58:24.004058595 (1h18m45.74811547s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:24.004069029 (1h18m45.748125898s) [upload=1357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:24.004073772 (1h18m45.748130633s) [upload=1357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:24.164829028 (1h18m45.908885897s) [upload=1357]: Done uploading segments... Aug 7 10:58:24.164853529 (1h18m45.908910393s) [upload=1357]: Upload finished. err: <nil> Aug 7 10:59:03.370549229 (1h19m25.114606089s) [upload=1366]: Starting upload Aug 7 10:59:03.370620412 (1h19m25.114677272s) [upload=1366]: Done starting upload Aug 7 10:59:03.370746566 (1h19m25.114803424s) [upload=1366]: Uploading segments... Aug 7 10:59:03.370815848 (1h19m25.114872717s) [upload=1366]: Got next segment. Inline: true Aug 7 10:59:03.370821928 (1h19m25.114878788s) [upload=1366]: Waiting for error group managing segments... Aug 7 10:59:03.370869165 (1h19m25.114926015s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:03.370885306 (1h19m25.114942168s) [upload=1366]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:03.370888948 (1h19m25.114945809s) [upload=1366]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:03.533669216 (1h19m25.277726077s) [upload=1366]: Done uploading segments... Aug 7 10:59:03.533689331 (1h19m25.27774618s) [upload=1366]: Upload finished. err: <nil> Aug 7 10:59:45.111236475 (1h20m6.85529334s) [upload=1377]: Starting upload Aug 7 10:59:45.111304535 (1h20m6.855361401s) [upload=1377]: Done starting upload Aug 7 10:59:45.111359475 (1h20m6.855416325s) [upload=1377]: Uploading segments... Aug 7 10:59:45.111449550 (1h20m6.855506418s) [upload=1377]: Got next segment. Inline: true Aug 7 10:59:45.111456455 (1h20m6.855513304s) [upload=1377]: Waiting for error group managing segments... Aug 7 10:59:45.111544766 (1h20m6.855601614s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:45.111551017 (1h20m6.855607867s) [upload=1377]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:45.111556997 (1h20m6.855613851s) [upload=1377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:45.269089475 (1h20m7.013146325s) [upload=1377]: Done uploading segments... Aug 7 10:59:45.269130635 (1h20m7.013187496s) [upload=1377]: Upload finished. err: <nil> Aug 7 11:00:54.046906444 (1h21m15.790963311s) [upload=1399]: Starting upload Aug 7 11:00:54.047022704 (1h21m15.791079583s) [upload=1399]: Done starting upload Aug 7 11:00:54.047098220 (1h21m15.791155074s) [upload=1399]: Uploading segments... Aug 7 11:00:54.047141037 (1h21m15.791197906s) [upload=1399]: Got next segment. Inline: true Aug 7 11:00:54.047146398 (1h21m15.791203248s) [upload=1399]: Waiting for error group managing segments... Aug 7 11:00:54.047194991 (1h21m15.791251862s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:54.047201218 (1h21m15.791258084s) [upload=1399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:54.047204703 (1h21m15.791261568s) [upload=1399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:54.203542612 (1h21m15.947599463s) [upload=1399]: Done uploading segments... Aug 7 11:00:54.203563505 (1h21m15.947620356s) [upload=1399]: Upload finished. err: <nil> Aug 7 11:01:30.116750716 (1h21m51.860807583s) [upload=1410]: Starting upload Aug 7 11:01:30.116811467 (1h21m51.860868332s) [upload=1410]: Done starting upload Aug 7 11:01:30.116894675 (1h21m51.860951533s) [upload=1410]: Uploading segments... Aug 7 11:01:30.116961319 (1h21m51.86101819s) [upload=1410]: Got next segment. Inline: true Aug 7 11:01:30.116967808 (1h21m51.86102467s) [upload=1410]: Waiting for error group managing segments... Aug 7 11:01:30.117023997 (1h21m51.861080864s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:30.117031166 (1h21m51.861088027s) [upload=1410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:30.117035815 (1h21m51.861092682s) [upload=1410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:30.337458072 (1h21m52.081514951s) [upload=1410]: Done uploading segments... Aug 7 11:01:30.337482162 (1h21m52.081539011s) [upload=1410]: Upload finished. err: <nil> Aug 7 11:01:58.127494658 (1h22m19.871551507s) [upload=1419]: Starting upload Aug 7 11:01:58.127564664 (1h22m19.871621524s) [upload=1419]: Done starting upload Aug 7 11:01:58.127765945 (1h22m19.87182281s) [upload=1419]: Uploading segments... Aug 7 11:01:58.127847348 (1h22m19.871904218s) [upload=1419]: Got next segment. Inline: true Aug 7 11:01:58.127854613 (1h22m19.871911473s) [upload=1419]: Waiting for error group managing segments... Aug 7 11:01:58.127918612 (1h22m19.871975462s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:01:58.127924221 (1h22m19.87198108s) [upload=1419]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:01:58.127927798 (1h22m19.871984658s) [upload=1419]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:01:58.279006645 (1h22m20.023063497s) [upload=1419]: Done uploading segments... Aug 7 11:01:58.279025748 (1h22m20.023082598s) [upload=1419]: Upload finished. err: <nil> Aug 7 11:02:59.978694468 (1h23m21.722751328s) [upload=1437]: Starting upload Aug 7 11:02:59.978755519 (1h23m21.72281238s) [upload=1437]: Done starting upload Aug 7 11:02:59.978875239 (1h23m21.722932093s) [upload=1437]: Uploading segments... Aug 7 11:02:59.978942214 (1h23m21.722999075s) [upload=1437]: Got next segment. Inline: true Aug 7 11:02:59.978948795 (1h23m21.723005655s) [upload=1437]: Waiting for error group managing segments... Aug 7 11:02:59.978990798 (1h23m21.723047658s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:02:59.978995889 (1h23m21.723052749s) [upload=1437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:02:59.978999192 (1h23m21.723056051s) [upload=1437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:00.162710758 (1h23m21.906767623s) [upload=1437]: Done uploading segments... Aug 7 11:03:00.162736410 (1h23m21.906793283s) [upload=1437]: Upload finished. err: <nil> Aug 7 11:03:37.973365599 (1h23m59.717422445s) [upload=1448]: Starting upload Aug 7 11:03:37.973419322 (1h23m59.717476185s) [upload=1448]: Done starting upload Aug 7 11:03:37.973488892 (1h23m59.717545738s) [upload=1448]: Uploading segments... Aug 7 11:03:37.973525359 (1h23m59.717582228s) [upload=1448]: Got next segment. Inline: true Aug 7 11:03:37.973529663 (1h23m59.717586522s) [upload=1448]: Waiting for error group managing segments... Aug 7 11:03:37.973565918 (1h23m59.717622764s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:03:37.973570343 (1h23m59.717627202s) [upload=1448]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:03:37.973572932 (1h23m59.717629792s) [upload=1448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:03:38.147298213 (1h23m59.891355063s) [upload=1448]: Done uploading segments... Aug 7 11:03:38.147321750 (1h23m59.891378604s) [upload=1448]: Upload finished. err: <nil> Aug 7 11:04:02.694590362 (1h24m24.438647232s) [upload=1456]: Starting upload Aug 7 11:04:02.694665677 (1h24m24.438722553s) [upload=1456]: Done starting upload Aug 7 11:04:02.694804072 (1h24m24.438860936s) [upload=1456]: Uploading segments... Aug 7 11:04:02.694870101 (1h24m24.438926977s) [upload=1456]: Got next segment. Inline: true Aug 7 11:04:02.694878281 (1h24m24.43893515s) [upload=1456]: Waiting for error group managing segments... Aug 7 11:04:02.694960774 (1h24m24.439017641s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:02.694967608 (1h24m24.439024471s) [upload=1456]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:02.694975221 (1h24m24.439032089s) [upload=1456]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:02.841492089 (1h24m24.585548964s) [upload=1456]: Done uploading segments... Aug 7 11:04:02.841517303 (1h24m24.585574167s) [upload=1456]: Upload finished. err: <nil> Aug 7 11:04:36.507491252 (1h24m58.251548102s) [upload=1467]: Starting upload Aug 7 11:04:36.507547220 (1h24m58.251604072s) [upload=1467]: Done starting upload Aug 7 11:04:36.507619876 (1h24m58.251676726s) [upload=1467]: Uploading segments... Aug 7 11:04:36.507802075 (1h24m58.251858945s) [upload=1467]: Got next segment. Inline: true Aug 7 11:04:36.507807432 (1h24m58.251864294s) [upload=1467]: Waiting for error group managing segments... Aug 7 11:04:36.507866385 (1h24m58.251923251s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:36.507873671 (1h24m58.251930541s) [upload=1467]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:04:36.507877434 (1h24m58.251934295s) [upload=1467]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:36.697717520 (1h24m58.441774385s) [upload=1467]: Done uploading segments... Aug 7 11:04:36.697744375 (1h24m58.441801236s) [upload=1467]: Upload finished. err: <nil> Duration:* 921.433598ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)