Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X...X.............X.......................................] duration:
2.561189372s
FAIL (2025-08-11 11:34:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.561215861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...X.............X......................................] duration:
2.440185091s
FAIL (2025-08-11 11:34:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.440242889s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.......................................................X..] duration:
861.793484ms
FAIL (2025-08-11 11:33:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 11:31:28.631412305 (66h5m50.59050955s) [upload=68866]: Starting upload Aug 11 11:31:28.631478339 (66h5m50.590575578s) [upload=68866]: Done starting upload Aug 11 11:31:28.631581349 (66h5m50.590678593s) [upload=68866]: Uploading segments... Aug 11 11:31:28.631668502 (66h5m50.590765757s) [upload=68866]: Got next segment. Inline: true Aug 11 11:31:28.631678770 (66h5m50.590776018s) [upload=68866]: Waiting for error group managing segments... Aug 11 11:31:28.631750156 (66h5m50.590847389s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 11:31:28.631762889 (66h5m50.590860121s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 11:31:28.631767150 (66h5m50.5908644s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 11:31:29.425456345 (66h5m51.38455358s) [upload=68866]: Done uploading segments... Aug 11 11:31:29.425476656 (66h5m51.384573891s) [upload=68866]: Upload finished. err: <nil>
Duration: 861.845095ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...X.............X.....................................] duration:
2.479655023s
FAIL (2025-08-11 11:33:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.47969506s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.......................................................X.] duration:
882.143403ms
FAIL (2025-08-11 11:32:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 11:31:28.631412305 (66h5m50.59050955s) [upload=68866]: Starting upload Aug 11 11:31:28.631478339 (66h5m50.590575578s) [upload=68866]: Done starting upload Aug 11 11:31:28.631581349 (66h5m50.590678593s) [upload=68866]: Uploading segments... Aug 11 11:31:28.631668502 (66h5m50.590765757s) [upload=68866]: Got next segment. Inline: true Aug 11 11:31:28.631678770 (66h5m50.590776018s) [upload=68866]: Waiting for error group managing segments... Aug 11 11:31:28.631750156 (66h5m50.590847389s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 11:31:28.631762889 (66h5m50.590860121s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 11:31:28.631767150 (66h5m50.5908644s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 11:31:29.425456345 (66h5m51.38455358s) [upload=68866]: Done uploading segments... Aug 11 11:31:29.425476656 (66h5m51.384573891s) [upload=68866]: Upload finished. err: <nil>
Duration: 882.188239ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...X.............X....................................] duration:
2.442023979s
FAIL (2025-08-11 11:32:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.442061043s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...X.............X...................................] duration:
2.413362544s
FAIL (2025-08-11 11:31:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.413392877s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.......................................................X] duration:
1.284832942s
FAIL (2025-08-11 11:31:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 11:31:28.631412305 (66h5m50.59050955s) [upload=68866]: Starting upload Aug 11 11:31:28.631478339 (66h5m50.590575578s) [upload=68866]: Done starting upload Aug 11 11:31:28.631581349 (66h5m50.590678593s) [upload=68866]: Uploading segments... Aug 11 11:31:28.631668502 (66h5m50.590765757s) [upload=68866]: Got next segment. Inline: true Aug 11 11:31:28.631678770 (66h5m50.590776018s) [upload=68866]: Waiting for error group managing segments... Aug 11 11:31:28.631750156 (66h5m50.590847389s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 11:31:28.631762889 (66h5m50.590860121s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 11:31:28.631767150 (66h5m50.5908644s) [upload=68866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 11:31:29.425456345 (66h5m51.38455358s) [upload=68866]: Done uploading segments... Aug 11 11:31:29.425476656 (66h5m51.384573891s) [upload=68866]: Upload finished. err: <nil>
Duration: 1.284950434s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...X.............X..................................] duration:
3.088541337s
FAIL (2025-08-11 11:31:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 3.088569807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
849.651195ms
FAIL (2025-08-11 11:30:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.686085ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...X.............X.................................] duration:
2.499996672s
FAIL (2025-08-11 11:30:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.500042697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
838.837455ms
FAIL (2025-08-11 11:29:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.874365ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...X.............X................................] duration:
2.269827096s
FAIL (2025-08-11 11:29:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.269860983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
872.810506ms
FAIL (2025-08-11 11:29:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 872.846864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...X.............X...............................] duration:
2.648162255s
FAIL (2025-08-11 11:29:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.648290899s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
838.173467ms
FAIL (2025-08-11 11:29:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.20767ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...X.............X..............................] duration:
2.634972442s
FAIL (2025-08-11 11:28:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.635002149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
830.547897ms
FAIL (2025-08-11 11:28:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.580103ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...X.............X.............................] duration:
2.418590076s
FAIL (2025-08-11 11:28:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.418620976s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
829.588735ms
FAIL (2025-08-11 11:28:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.615551ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
881.891491ms
FAIL (2025-08-11 11:27:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 881.926655ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...X.............X............................] duration:
2.356495303s
FAIL (2025-08-11 11:27:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.356537645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
855.441506ms
FAIL (2025-08-11 11:27:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.492586ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
830.701292ms
FAIL (2025-08-11 11:26:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.733119ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...X.............X...........................] duration:
2.394849459s
FAIL (2025-08-11 11:26:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.394908715s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...X.............X..........................] duration:
2.506529612s
FAIL (2025-08-11 11:26:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.506628124s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
888.388904ms
FAIL (2025-08-11 11:25:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 888.421355ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...X.............X.........................] duration:
2.403486119s
FAIL (2025-08-11 11:25:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.403516081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.082714088s
FAIL (2025-08-11 11:25:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.082742006s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...X.............X........................] duration:
2.58278569s
FAIL (2025-08-11 11:24:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.582893115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..............X............................................] duration:
931.795585ms
FAIL (2025-08-11 11:24:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 931.818417ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..............X...........................................] duration:
830.427314ms
FAIL (2025-08-11 11:24:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.458765ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X...X.............X.......................] duration:
2.247312932s
FAIL (2025-08-11 11:23:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.24740207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..............X..........................................] duration:
916.599934ms
FAIL (2025-08-11 11:23:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 916.633358ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X...X.............X......................] duration:
2.408057819s
FAIL (2025-08-11 11:22:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.408086776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..............X.........................................] duration:
837.276156ms
FAIL (2025-08-11 11:22:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.308098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X...X.............X.....................] duration:
2.438066256s
FAIL (2025-08-11 11:22:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.438098746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..............X........................................] duration:
976.069294ms
FAIL (2025-08-11 11:21:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 976.104368ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X...X.............X....................] duration:
2.299018297s
FAIL (2025-08-11 11:21:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.299072754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............X.......................................] duration:
1.908345476s
FAIL (2025-08-11 11:21:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.908375175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..............X......................................] duration:
847.328527ms
FAIL (2025-08-11 11:21:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.372888ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X...X.............X...................] duration:
2.381256443s
FAIL (2025-08-11 11:20:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.381285517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..............X.....................................] duration:
947.780628ms
FAIL (2025-08-11 11:20:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 947.813719ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X...X.............X..................] duration:
2.427942984s
FAIL (2025-08-11 11:19:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.427980929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..............X....................................] duration:
847.883619ms
FAIL (2025-08-11 11:19:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.911516ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X...X.............X.................] duration:
2.355972283s
FAIL (2025-08-11 11:19:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.356032109s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X........X..............X...................................] duration:
904.396503ms
FAIL (2025-08-11 11:19:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 904.432694ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X........X..............X..................................] duration:
863.713493ms
FAIL (2025-08-11 11:18:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.74532ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X........X..............X.................................] duration:
840.76283ms
FAIL (2025-08-11 11:18:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 840.789595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X...X.............X................] duration:
2.601691135s
FAIL (2025-08-11 11:18:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 11:04:25.922993172 (65h38m47.882090407s) [upload=68393]: Starting upload
Aug 11 11:04:25.923056257 (65h38m47.882153505s) [upload=68393]: Done starting upload
Aug 11 11:04:25.923196892 (65h38m47.882294138s) [upload=68393]: Uploading segments...
Aug 11 11:04:25.923362328 (65h38m47.882459561s) [upload=68393]: Got next segment. Inline: false
Aug 11 11:04:25.923414619 (65h38m47.882511851s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 11:04:25.923420140 (65h38m47.882517388s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 11:04:26.128191311 (65h38m48.087288558s) [seg_pos={0 0}, upload=68393]: Begin upload segment...
Aug 11 11:04:26.128294249 (65h38m48.087391503s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.128910521 (65h38m48.088007759s) [seg_pos={0 0}, upload=68393]: Done begin upload segment.
Aug 11 11:04:26.128957715 (65h38m48.088054964s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129434238 (65h38m48.088531486s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.129837507 (65h38m48.088934765s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130039961 (65h38m48.089137212s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130334536 (65h38m48.089431782s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.130706666 (65h38m48.089803911s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138131376 (65h38m48.097228629s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.138618361 (65h38m48.097715616s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139087646 (65h38m48.098184894s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139424247 (65h38m48.098521492s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.139763344 (65h38m48.098860592s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140087419 (65h38m48.099184671s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140420188 (65h38m48.099517433s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.140854577 (65h38m48.099951833s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.141231909 (65h38m48.100329157s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.159973267 (65h38m48.119070506s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.160905856 (65h38m48.120003144s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Uploading piece...
Aug 11 11:04:26.704183144 (65h38m48.66328038s) [upload=68393]: Next returned nil segment
Aug 11 11:04:26.704200779 (65h38m48.663298024s) [upload=68393]: Waiting for error group managing segments...
Aug 11 11:04:26.878663440 (65h38m48.837760675s) [noise=true , address=104.36.82.38:4706 , piece_id=62OHZQS5DGB6ZXYZBZRGRHQN6DHJPDLZWMWVBNUUCMVBJOICDKZA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883165809 (65h38m48.842263044s) [noise=true , address=104.36.82.15:4292 , piece_id=6ASHFI24SMDUSSZLGQFZJWSC5VMFAIK6EA67HIS47Z6CMLUTJYXA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.883640771 (65h38m48.842738052s) [noise=true , address=104.36.82.60:4337 , piece_id=Y7CEKZNRJW7HKYZN5I73HEJ3RDAGIURC4HGUP4YXRBREAZD6LEUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.884113266 (65h38m48.843210514s) [noise=true , address=104.36.82.35:4587 , piece_id=OH4L52NXXW4DJO3QJFALA3EE2E6JFSP5QTO2AW43JPGGAWI7TYCA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.886654136 (65h38m48.845751381s) [noise=true , address=104.36.82.62:4427 , piece_id=6ZFOUMNV2UK46XYRGQ5Q7WKJJSR52QNNGZUDVLG3JCMH3L3EQNYA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.889655089 (65h38m48.848752335s) [noise=true , address=104.36.82.49:4003 , piece_id=JOKYUQVUH5BPFR7P6ZJB4MKXSJRFBLVDBWSZACW2BWNZUT3IYFUA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.890751165 (65h38m48.849848396s) [noise=true , address=104.36.82.39:4748 , piece_id=NXL3ZCBJVNA6CDVBCM3ZNYYLV6OBS2LZ2B7WH7UGMCHHK3LETFDA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.892238008 (65h38m48.851335247s) [noise=true , address=104.36.82.34:4572 , piece_id=AOBKVVW3BSVEEXA4PF2PGWHBHCBQNX2U4YR4G4CDA7NPFMX4NRWQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.906096972 (65h38m48.865194238s) [noise=true , address=104.36.82.59:4304 , piece_id=VBNWI3NWDYZWM7FF6CJH3KII4LLBPRSQT6K4RD3PIGKGXP6MHOLQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.910572849 (65h38m48.869670096s) [noise=true , address=104.36.82.44:4899 , piece_id=J7PUA7FIRYG6VLQXC7PWPLZ43QFE4KC5Z3YNQ3ETHZI6PSR6X7CA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.912725207 (65h38m48.871822447s) [noise=true , address=104.36.82.58:4294 , piece_id=KLWZLD5MRREEK3ZYCNHAPRAD4MF2OBMI2JJFOSGX7BYCXCLPATIQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917071354 (65h38m48.876168593s) [noise=true , address=104.36.82.5:4843 , piece_id=NKO5JX5R6RH2B5MTI2PFWJTXULVOPUZ6SJSLDOOGVA4Z2WL5EAVQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.917558105 (65h38m48.876655344s) [noise=true , address=104.36.82.16:4325 , piece_id=MAIU2RRNGZX5L5V2CWS73SVJ53Q43QCX7EGNUTUF64X2OI5XZ6YQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924269577 (65h38m48.883366815s) [noise=true , address=104.36.82.23:4474 , piece_id=VESKOZXOC5H74GIQHE6NT36ZLVEF2RYMNG2F6FQG5FGKDUK2NAOA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: <nil>
Aug 11 11:04:26.924302130 (65h38m48.883399377s) [seg_pos={0 0}, upload=68393]: Segment reached optimal threshold of 14 pieces.
Aug 11 11:04:26.924959249 (65h38m48.884056486s) [noise=true , address=104.36.82.18:4373 , piece_id=IIRG6YT73YSAWCMR43MFX67K2IO3MUNUOO5CVJITVBWC4MOD75TQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15mMVPTHstsqsVfqLCXfm6i6BBowXGaVonjUPxGUuHafjHWwog): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925095167 (65h38m48.884192405s) [noise=true , address=64.49.13.140:4514 , piece_id=FCJ7JM2MNX7SS5XFABNKQ45HDLSKO6FGPZMCQJV53P5UTYUV5CFA, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56986->64.49.13.140:4514: use of closed network connection
Aug 11 11:04:26.925164615 (65h38m48.884261853s) [noise=true , address=104.36.82.22:4520 , piece_id=7H7ZXNFJ55RMJJXU36G5FYKYUZI6XDXGKNS47DV6IJF2DRFDQVPQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925245051 (65h38m48.884342289s) [noise=true , address=104.36.82.59:4314 , piece_id=JPSBYFE6EMKCA265KESP6VN7HCTSE5O6YWA3BQ5L4CUV4H3XZMFQ, seg_pos={0 0}, upload=68393]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EsmL66Gn6K9cUxHqqGtuUZxUGyWCNL4oqyHzS1XUbWVnMMJbd): protocol: expected piece hash; context canceled; EOF
Aug 11 11:04:26.925258698 (65h38m48.884355943s) [seg_pos={0 0}, upload=68393]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 11:04:26.925346995 (65h38m48.884444241s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 11:04:26.925352010 (65h38m48.884449255s) [upload=68393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 11:04:27.102774979 (65h38m49.061872224s) [upload=68393]: Done uploading segments...
Aug 11 11:04:27.102812273 (65h38m49.06190952s) [upload=68393]: Upload finished. err: <nil>
Duration: 2.601729384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|