Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X...................................X......] duration:
2.867446956s
FAIL (2025-08-10 21:59:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 21:54:49.413506489 (52h29m11.372603737s) [upload=54690]: Starting upload
Aug 10 21:54:49.413567934 (52h29m11.372665183s) [upload=54690]: Done starting upload
Aug 10 21:54:49.413851799 (52h29m11.37294903s) [upload=54690]: Uploading segments...
Aug 10 21:54:49.413894274 (52h29m11.372991528s) [upload=54690]: Got next segment. Inline: false
Aug 10 21:54:49.413954042 (52h29m11.373051287s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 21:54:49.413958953 (52h29m11.373056198s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 21:54:49.612619906 (52h29m11.571717155s) [seg_pos={0 0}, upload=54690]: Begin upload segment...
Aug 10 21:54:49.612685891 (52h29m11.571783133s) [seg_pos={0 0}, upload=54690]: Done begin upload segment.
Aug 10 21:54:49.612724061 (52h29m11.571821306s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.612767606 (52h29m11.571864861s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613179590 (52h29m11.572276839s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613278344 (52h29m11.572375596s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613507121 (52h29m11.572604367s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613809743 (52h29m11.572906991s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613855572 (52h29m11.572952827s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614303406 (52h29m11.573400657s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614581841 (52h29m11.573679092s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614954184 (52h29m11.574051435s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.615232406 (52h29m11.574329657s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618080149 (52h29m11.577177401s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618435168 (52h29m11.577532413s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618754043 (52h29m11.577851288s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619125146 (52h29m11.578222391s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619429297 (52h29m11.578526543s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619720336 (52h29m11.578817599s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.620038260 (52h29m11.579135506s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:50.201256570 (52h29m12.160353809s) [upload=54690]: Next returned nil segment
Aug 10 21:54:50.201292075 (52h29m12.16038932s) [upload=54690]: Waiting for error group managing segments...
Aug 10 21:54:50.343756729 (52h29m12.302853965s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.347598908 (52h29m12.306696153s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.360510774 (52h29m12.319608006s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.365349158 (52h29m12.32444639s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.366492121 (52h29m12.325589352s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.386324525 (52h29m12.345421764s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.393396481 (52h29m12.352493721s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.398125906 (52h29m12.357223145s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.420508371 (52h29m12.379605604s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622505652 (52h29m12.581602888s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622573447 (52h29m12.581670692s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.646075894 (52h29m12.60517313s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.735202745 (52h29m12.69429999s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849172178 (52h29m12.808269418s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849211617 (52h29m12.808308862s) [seg_pos={0 0}, upload=54690]: Segment reached optimal threshold of 14 pieces.
Aug 10 21:54:50.849449987 (52h29m12.808547232s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849549059 (52h29m12.808646297s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849653857 (52h29m12.808751088s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15QSJs47N4rSvAqkMdkc7d1TngEjd4aWhY1pDr7kxwogqeZK2q): protocol: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection
Aug 10 21:54:50.849701519 (52h29m12.808798765s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1meb5uwbGA8toEsGhaZxSqj4rh6TRWtCM8gD5PxmTh57BLJYaS): protocol: read tcp 139.59.144.22:57414->104.36.82.16:4323: use of closed network connection; context canceled
Aug 10 21:54:50.849736637 (52h29m12.808833876s) [seg_pos={0 0}, upload=54690]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 21:54:50.849824879 (52h29m12.808922127s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 21:54:50.849830297 (52h29m12.808927543s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 21:54:51.011403787 (52h29m12.970501023s) [upload=54690]: Done uploading segments...
Aug 10 21:54:51.011436253 (52h29m12.970533488s) [upload=54690]: Upload finished. err: <nil>
Duration: 2.867475777s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X...................................X.....] duration:
3.118852375s
FAIL (2025-08-10 21:59:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 21:54:49.413506489 (52h29m11.372603737s) [upload=54690]: Starting upload
Aug 10 21:54:49.413567934 (52h29m11.372665183s) [upload=54690]: Done starting upload
Aug 10 21:54:49.413851799 (52h29m11.37294903s) [upload=54690]: Uploading segments...
Aug 10 21:54:49.413894274 (52h29m11.372991528s) [upload=54690]: Got next segment. Inline: false
Aug 10 21:54:49.413954042 (52h29m11.373051287s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 21:54:49.413958953 (52h29m11.373056198s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 21:54:49.612619906 (52h29m11.571717155s) [seg_pos={0 0}, upload=54690]: Begin upload segment...
Aug 10 21:54:49.612685891 (52h29m11.571783133s) [seg_pos={0 0}, upload=54690]: Done begin upload segment.
Aug 10 21:54:49.612724061 (52h29m11.571821306s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.612767606 (52h29m11.571864861s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613179590 (52h29m11.572276839s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613278344 (52h29m11.572375596s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613507121 (52h29m11.572604367s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613809743 (52h29m11.572906991s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613855572 (52h29m11.572952827s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614303406 (52h29m11.573400657s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614581841 (52h29m11.573679092s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614954184 (52h29m11.574051435s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.615232406 (52h29m11.574329657s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618080149 (52h29m11.577177401s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618435168 (52h29m11.577532413s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618754043 (52h29m11.577851288s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619125146 (52h29m11.578222391s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619429297 (52h29m11.578526543s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619720336 (52h29m11.578817599s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.620038260 (52h29m11.579135506s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:50.201256570 (52h29m12.160353809s) [upload=54690]: Next returned nil segment
Aug 10 21:54:50.201292075 (52h29m12.16038932s) [upload=54690]: Waiting for error group managing segments...
Aug 10 21:54:50.343756729 (52h29m12.302853965s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.347598908 (52h29m12.306696153s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.360510774 (52h29m12.319608006s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.365349158 (52h29m12.32444639s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.366492121 (52h29m12.325589352s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.386324525 (52h29m12.345421764s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.393396481 (52h29m12.352493721s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.398125906 (52h29m12.357223145s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.420508371 (52h29m12.379605604s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622505652 (52h29m12.581602888s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622573447 (52h29m12.581670692s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.646075894 (52h29m12.60517313s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.735202745 (52h29m12.69429999s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849172178 (52h29m12.808269418s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849211617 (52h29m12.808308862s) [seg_pos={0 0}, upload=54690]: Segment reached optimal threshold of 14 pieces.
Aug 10 21:54:50.849449987 (52h29m12.808547232s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849549059 (52h29m12.808646297s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849653857 (52h29m12.808751088s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15QSJs47N4rSvAqkMdkc7d1TngEjd4aWhY1pDr7kxwogqeZK2q): protocol: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection
Aug 10 21:54:50.849701519 (52h29m12.808798765s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1meb5uwbGA8toEsGhaZxSqj4rh6TRWtCM8gD5PxmTh57BLJYaS): protocol: read tcp 139.59.144.22:57414->104.36.82.16:4323: use of closed network connection; context canceled
Aug 10 21:54:50.849736637 (52h29m12.808833876s) [seg_pos={0 0}, upload=54690]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 21:54:50.849824879 (52h29m12.808922127s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 21:54:50.849830297 (52h29m12.808927543s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 21:54:51.011403787 (52h29m12.970501023s) [upload=54690]: Done uploading segments...
Aug 10 21:54:51.011436253 (52h29m12.970533488s) [upload=54690]: Upload finished. err: <nil>
Duration: 3.11888426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
837.083681ms
FAIL (2025-08-10 21:58:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.150527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
864.100002ms
FAIL (2025-08-10 21:58:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.12914ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...................................X....] duration:
2.662190088s
FAIL (2025-08-10 21:58:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 21:54:49.413506489 (52h29m11.372603737s) [upload=54690]: Starting upload
Aug 10 21:54:49.413567934 (52h29m11.372665183s) [upload=54690]: Done starting upload
Aug 10 21:54:49.413851799 (52h29m11.37294903s) [upload=54690]: Uploading segments...
Aug 10 21:54:49.413894274 (52h29m11.372991528s) [upload=54690]: Got next segment. Inline: false
Aug 10 21:54:49.413954042 (52h29m11.373051287s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 21:54:49.413958953 (52h29m11.373056198s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 21:54:49.612619906 (52h29m11.571717155s) [seg_pos={0 0}, upload=54690]: Begin upload segment...
Aug 10 21:54:49.612685891 (52h29m11.571783133s) [seg_pos={0 0}, upload=54690]: Done begin upload segment.
Aug 10 21:54:49.612724061 (52h29m11.571821306s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.612767606 (52h29m11.571864861s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613179590 (52h29m11.572276839s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613278344 (52h29m11.572375596s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613507121 (52h29m11.572604367s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613809743 (52h29m11.572906991s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613855572 (52h29m11.572952827s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614303406 (52h29m11.573400657s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614581841 (52h29m11.573679092s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614954184 (52h29m11.574051435s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.615232406 (52h29m11.574329657s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618080149 (52h29m11.577177401s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618435168 (52h29m11.577532413s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618754043 (52h29m11.577851288s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619125146 (52h29m11.578222391s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619429297 (52h29m11.578526543s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619720336 (52h29m11.578817599s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.620038260 (52h29m11.579135506s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:50.201256570 (52h29m12.160353809s) [upload=54690]: Next returned nil segment
Aug 10 21:54:50.201292075 (52h29m12.16038932s) [upload=54690]: Waiting for error group managing segments...
Aug 10 21:54:50.343756729 (52h29m12.302853965s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.347598908 (52h29m12.306696153s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.360510774 (52h29m12.319608006s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.365349158 (52h29m12.32444639s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.366492121 (52h29m12.325589352s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.386324525 (52h29m12.345421764s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.393396481 (52h29m12.352493721s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.398125906 (52h29m12.357223145s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.420508371 (52h29m12.379605604s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622505652 (52h29m12.581602888s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622573447 (52h29m12.581670692s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.646075894 (52h29m12.60517313s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.735202745 (52h29m12.69429999s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849172178 (52h29m12.808269418s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849211617 (52h29m12.808308862s) [seg_pos={0 0}, upload=54690]: Segment reached optimal threshold of 14 pieces.
Aug 10 21:54:50.849449987 (52h29m12.808547232s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849549059 (52h29m12.808646297s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849653857 (52h29m12.808751088s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15QSJs47N4rSvAqkMdkc7d1TngEjd4aWhY1pDr7kxwogqeZK2q): protocol: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection
Aug 10 21:54:50.849701519 (52h29m12.808798765s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1meb5uwbGA8toEsGhaZxSqj4rh6TRWtCM8gD5PxmTh57BLJYaS): protocol: read tcp 139.59.144.22:57414->104.36.82.16:4323: use of closed network connection; context canceled
Aug 10 21:54:50.849736637 (52h29m12.808833876s) [seg_pos={0 0}, upload=54690]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 21:54:50.849824879 (52h29m12.808922127s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 21:54:50.849830297 (52h29m12.808927543s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 21:54:51.011403787 (52h29m12.970501023s) [upload=54690]: Done uploading segments...
Aug 10 21:54:51.011436253 (52h29m12.970533488s) [upload=54690]: Upload finished. err: <nil>
Duration: 2.662230102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
830.033317ms
FAIL (2025-08-10 21:57:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.062121ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X...................................X...] duration:
2.74891689s
FAIL (2025-08-10 21:57:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 21:54:49.413506489 (52h29m11.372603737s) [upload=54690]: Starting upload
Aug 10 21:54:49.413567934 (52h29m11.372665183s) [upload=54690]: Done starting upload
Aug 10 21:54:49.413851799 (52h29m11.37294903s) [upload=54690]: Uploading segments...
Aug 10 21:54:49.413894274 (52h29m11.372991528s) [upload=54690]: Got next segment. Inline: false
Aug 10 21:54:49.413954042 (52h29m11.373051287s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 21:54:49.413958953 (52h29m11.373056198s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 21:54:49.612619906 (52h29m11.571717155s) [seg_pos={0 0}, upload=54690]: Begin upload segment...
Aug 10 21:54:49.612685891 (52h29m11.571783133s) [seg_pos={0 0}, upload=54690]: Done begin upload segment.
Aug 10 21:54:49.612724061 (52h29m11.571821306s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.612767606 (52h29m11.571864861s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613179590 (52h29m11.572276839s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613278344 (52h29m11.572375596s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613507121 (52h29m11.572604367s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613809743 (52h29m11.572906991s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613855572 (52h29m11.572952827s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614303406 (52h29m11.573400657s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614581841 (52h29m11.573679092s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614954184 (52h29m11.574051435s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.615232406 (52h29m11.574329657s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618080149 (52h29m11.577177401s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618435168 (52h29m11.577532413s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618754043 (52h29m11.577851288s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619125146 (52h29m11.578222391s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619429297 (52h29m11.578526543s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619720336 (52h29m11.578817599s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.620038260 (52h29m11.579135506s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:50.201256570 (52h29m12.160353809s) [upload=54690]: Next returned nil segment
Aug 10 21:54:50.201292075 (52h29m12.16038932s) [upload=54690]: Waiting for error group managing segments...
Aug 10 21:54:50.343756729 (52h29m12.302853965s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.347598908 (52h29m12.306696153s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.360510774 (52h29m12.319608006s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.365349158 (52h29m12.32444639s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.366492121 (52h29m12.325589352s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.386324525 (52h29m12.345421764s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.393396481 (52h29m12.352493721s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.398125906 (52h29m12.357223145s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.420508371 (52h29m12.379605604s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622505652 (52h29m12.581602888s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622573447 (52h29m12.581670692s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.646075894 (52h29m12.60517313s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.735202745 (52h29m12.69429999s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849172178 (52h29m12.808269418s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849211617 (52h29m12.808308862s) [seg_pos={0 0}, upload=54690]: Segment reached optimal threshold of 14 pieces.
Aug 10 21:54:50.849449987 (52h29m12.808547232s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849549059 (52h29m12.808646297s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849653857 (52h29m12.808751088s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15QSJs47N4rSvAqkMdkc7d1TngEjd4aWhY1pDr7kxwogqeZK2q): protocol: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection
Aug 10 21:54:50.849701519 (52h29m12.808798765s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1meb5uwbGA8toEsGhaZxSqj4rh6TRWtCM8gD5PxmTh57BLJYaS): protocol: read tcp 139.59.144.22:57414->104.36.82.16:4323: use of closed network connection; context canceled
Aug 10 21:54:50.849736637 (52h29m12.808833876s) [seg_pos={0 0}, upload=54690]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 21:54:50.849824879 (52h29m12.808922127s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 21:54:50.849830297 (52h29m12.808927543s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 21:54:51.011403787 (52h29m12.970501023s) [upload=54690]: Done uploading segments...
Aug 10 21:54:51.011436253 (52h29m12.970533488s) [upload=54690]: Upload finished. err: <nil>
Duration: 2.74895966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
862.42431ms
FAIL (2025-08-10 21:56:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.458097ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
847.185213ms
FAIL (2025-08-10 21:56:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.21239ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...................................X..] duration:
3.487956805s
FAIL (2025-08-10 21:56:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 21:54:49.413506489 (52h29m11.372603737s) [upload=54690]: Starting upload
Aug 10 21:54:49.413567934 (52h29m11.372665183s) [upload=54690]: Done starting upload
Aug 10 21:54:49.413851799 (52h29m11.37294903s) [upload=54690]: Uploading segments...
Aug 10 21:54:49.413894274 (52h29m11.372991528s) [upload=54690]: Got next segment. Inline: false
Aug 10 21:54:49.413954042 (52h29m11.373051287s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 21:54:49.413958953 (52h29m11.373056198s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 21:54:49.612619906 (52h29m11.571717155s) [seg_pos={0 0}, upload=54690]: Begin upload segment...
Aug 10 21:54:49.612685891 (52h29m11.571783133s) [seg_pos={0 0}, upload=54690]: Done begin upload segment.
Aug 10 21:54:49.612724061 (52h29m11.571821306s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.612767606 (52h29m11.571864861s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613179590 (52h29m11.572276839s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613278344 (52h29m11.572375596s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613507121 (52h29m11.572604367s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613809743 (52h29m11.572906991s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613855572 (52h29m11.572952827s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614303406 (52h29m11.573400657s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614581841 (52h29m11.573679092s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614954184 (52h29m11.574051435s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.615232406 (52h29m11.574329657s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618080149 (52h29m11.577177401s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618435168 (52h29m11.577532413s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618754043 (52h29m11.577851288s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619125146 (52h29m11.578222391s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619429297 (52h29m11.578526543s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619720336 (52h29m11.578817599s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.620038260 (52h29m11.579135506s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:50.201256570 (52h29m12.160353809s) [upload=54690]: Next returned nil segment
Aug 10 21:54:50.201292075 (52h29m12.16038932s) [upload=54690]: Waiting for error group managing segments...
Aug 10 21:54:50.343756729 (52h29m12.302853965s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.347598908 (52h29m12.306696153s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.360510774 (52h29m12.319608006s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.365349158 (52h29m12.32444639s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.366492121 (52h29m12.325589352s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.386324525 (52h29m12.345421764s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.393396481 (52h29m12.352493721s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.398125906 (52h29m12.357223145s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.420508371 (52h29m12.379605604s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622505652 (52h29m12.581602888s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622573447 (52h29m12.581670692s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.646075894 (52h29m12.60517313s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.735202745 (52h29m12.69429999s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849172178 (52h29m12.808269418s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849211617 (52h29m12.808308862s) [seg_pos={0 0}, upload=54690]: Segment reached optimal threshold of 14 pieces.
Aug 10 21:54:50.849449987 (52h29m12.808547232s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849549059 (52h29m12.808646297s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849653857 (52h29m12.808751088s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15QSJs47N4rSvAqkMdkc7d1TngEjd4aWhY1pDr7kxwogqeZK2q): protocol: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection
Aug 10 21:54:50.849701519 (52h29m12.808798765s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1meb5uwbGA8toEsGhaZxSqj4rh6TRWtCM8gD5PxmTh57BLJYaS): protocol: read tcp 139.59.144.22:57414->104.36.82.16:4323: use of closed network connection; context canceled
Aug 10 21:54:50.849736637 (52h29m12.808833876s) [seg_pos={0 0}, upload=54690]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 21:54:50.849824879 (52h29m12.808922127s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 21:54:50.849830297 (52h29m12.808927543s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 21:54:51.011403787 (52h29m12.970501023s) [upload=54690]: Done uploading segments...
Aug 10 21:54:51.011436253 (52h29m12.970533488s) [upload=54690]: Upload finished. err: <nil>
Duration: 3.488002713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...................................X.] duration:
2.837255704s
FAIL (2025-08-10 21:55:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 21:54:49.413506489 (52h29m11.372603737s) [upload=54690]: Starting upload
Aug 10 21:54:49.413567934 (52h29m11.372665183s) [upload=54690]: Done starting upload
Aug 10 21:54:49.413851799 (52h29m11.37294903s) [upload=54690]: Uploading segments...
Aug 10 21:54:49.413894274 (52h29m11.372991528s) [upload=54690]: Got next segment. Inline: false
Aug 10 21:54:49.413954042 (52h29m11.373051287s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 21:54:49.413958953 (52h29m11.373056198s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 21:54:49.612619906 (52h29m11.571717155s) [seg_pos={0 0}, upload=54690]: Begin upload segment...
Aug 10 21:54:49.612685891 (52h29m11.571783133s) [seg_pos={0 0}, upload=54690]: Done begin upload segment.
Aug 10 21:54:49.612724061 (52h29m11.571821306s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.612767606 (52h29m11.571864861s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613179590 (52h29m11.572276839s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613278344 (52h29m11.572375596s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613507121 (52h29m11.572604367s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613809743 (52h29m11.572906991s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613855572 (52h29m11.572952827s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614303406 (52h29m11.573400657s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614581841 (52h29m11.573679092s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614954184 (52h29m11.574051435s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.615232406 (52h29m11.574329657s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618080149 (52h29m11.577177401s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618435168 (52h29m11.577532413s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618754043 (52h29m11.577851288s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619125146 (52h29m11.578222391s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619429297 (52h29m11.578526543s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619720336 (52h29m11.578817599s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.620038260 (52h29m11.579135506s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:50.201256570 (52h29m12.160353809s) [upload=54690]: Next returned nil segment
Aug 10 21:54:50.201292075 (52h29m12.16038932s) [upload=54690]: Waiting for error group managing segments...
Aug 10 21:54:50.343756729 (52h29m12.302853965s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.347598908 (52h29m12.306696153s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.360510774 (52h29m12.319608006s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.365349158 (52h29m12.32444639s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.366492121 (52h29m12.325589352s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.386324525 (52h29m12.345421764s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.393396481 (52h29m12.352493721s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.398125906 (52h29m12.357223145s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.420508371 (52h29m12.379605604s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622505652 (52h29m12.581602888s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622573447 (52h29m12.581670692s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.646075894 (52h29m12.60517313s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.735202745 (52h29m12.69429999s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849172178 (52h29m12.808269418s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849211617 (52h29m12.808308862s) [seg_pos={0 0}, upload=54690]: Segment reached optimal threshold of 14 pieces.
Aug 10 21:54:50.849449987 (52h29m12.808547232s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849549059 (52h29m12.808646297s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849653857 (52h29m12.808751088s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15QSJs47N4rSvAqkMdkc7d1TngEjd4aWhY1pDr7kxwogqeZK2q): protocol: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection
Aug 10 21:54:50.849701519 (52h29m12.808798765s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1meb5uwbGA8toEsGhaZxSqj4rh6TRWtCM8gD5PxmTh57BLJYaS): protocol: read tcp 139.59.144.22:57414->104.36.82.16:4323: use of closed network connection; context canceled
Aug 10 21:54:50.849736637 (52h29m12.808833876s) [seg_pos={0 0}, upload=54690]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 21:54:50.849824879 (52h29m12.808922127s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 21:54:50.849830297 (52h29m12.808927543s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 21:54:51.011403787 (52h29m12.970501023s) [upload=54690]: Done uploading segments...
Aug 10 21:54:51.011436253 (52h29m12.970533488s) [upload=54690]: Upload finished. err: <nil>
Duration: 2.837283701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.001016548s
FAIL (2025-08-10 21:55:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.001042923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.........................X.................................] duration:
846.38808ms
FAIL (2025-08-10 21:54:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.409544ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...................................X] duration:
2.069510855s
FAIL (2025-08-10 21:54:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 21:54:49.413506489 (52h29m11.372603737s) [upload=54690]: Starting upload
Aug 10 21:54:49.413567934 (52h29m11.372665183s) [upload=54690]: Done starting upload
Aug 10 21:54:49.413851799 (52h29m11.37294903s) [upload=54690]: Uploading segments...
Aug 10 21:54:49.413894274 (52h29m11.372991528s) [upload=54690]: Got next segment. Inline: false
Aug 10 21:54:49.413954042 (52h29m11.373051287s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 21:54:49.413958953 (52h29m11.373056198s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 21:54:49.612619906 (52h29m11.571717155s) [seg_pos={0 0}, upload=54690]: Begin upload segment...
Aug 10 21:54:49.612685891 (52h29m11.571783133s) [seg_pos={0 0}, upload=54690]: Done begin upload segment.
Aug 10 21:54:49.612724061 (52h29m11.571821306s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.612767606 (52h29m11.571864861s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613179590 (52h29m11.572276839s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613278344 (52h29m11.572375596s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613507121 (52h29m11.572604367s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613809743 (52h29m11.572906991s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.613855572 (52h29m11.572952827s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614303406 (52h29m11.573400657s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614581841 (52h29m11.573679092s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.614954184 (52h29m11.574051435s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.615232406 (52h29m11.574329657s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618080149 (52h29m11.577177401s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618435168 (52h29m11.577532413s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.618754043 (52h29m11.577851288s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619125146 (52h29m11.578222391s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619429297 (52h29m11.578526543s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.619720336 (52h29m11.578817599s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:49.620038260 (52h29m11.579135506s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Uploading piece...
Aug 10 21:54:50.201256570 (52h29m12.160353809s) [upload=54690]: Next returned nil segment
Aug 10 21:54:50.201292075 (52h29m12.16038932s) [upload=54690]: Waiting for error group managing segments...
Aug 10 21:54:50.343756729 (52h29m12.302853965s) [noise=true , address=45.91.116.13:4171 , piece_id=H44WHQRZPV3HB2Y72SVUGHKWCG6BFAXGZOR3Y5RXBEKL65WAXPXA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.347598908 (52h29m12.306696153s) [noise=true , address=79.127.219.47:4039 , piece_id=O5PMKQ45XNFO35R3QMYFRSSK7EGNP2NAPACZFBAH6S55Q4QRN7YQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.360510774 (52h29m12.319608006s) [noise=true , address=104.36.82.15:4291 , piece_id=C5O3NRORHSIPMS6K7PFCLRWDBQBGQLJ7IFAUIPFMWFR6AEIRWJ4Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.365349158 (52h29m12.32444639s) [noise=true , address=104.36.82.45:4937 , piece_id=4T5YSUQMKRANYHBL34V7L36HU2G5MZQGK6H3LGXI56Q4OP6KHVUA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.366492121 (52h29m12.325589352s) [noise=true , address=104.36.82.55:4193 , piece_id=VOOA4JK4QF5OGLRJ4HGQNQOPYBQDYPHCT6CBFIIE3E4DFOBHQ2HQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.386324525 (52h29m12.345421764s) [noise=true , address=104.36.82.61:4382 , piece_id=Y3Q6C2DBQWFJVMTHWNM5TKWKEJN2CYO745BTZZFVVNGVO6SDTCGA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.393396481 (52h29m12.352493721s) [noise=true , address=104.36.82.23:4455 , piece_id=7Z46ZXLEGUFTVMWAWBFUY7VV2Y2ERFUJS7OOQYLMN2R5U5ZGU6DQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.398125906 (52h29m12.357223145s) [noise=true , address=104.36.82.36:4638 , piece_id=HONRX4HZDEEH3MPCQI27ESOJ42DXNGPBEPZEXFGTSZRWNWSEOQMQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.420508371 (52h29m12.379605604s) [noise=true , address=104.36.82.2:4763 , piece_id=U4EDGTCBZOLFGJBYZTT3ITS3UFTRFU4HW3CNZVLWETVSN6OYYCXQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622505652 (52h29m12.581602888s) [noise=true , address=104.36.82.5:4850 , piece_id=P3SULATKMQINGKJEDXBG44FSY3J7KU5NCZCURJWBC7V6JMRBHYDA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.622573447 (52h29m12.581670692s) [noise=true , address=79.127.201.215:4347 , piece_id=JCQHOV7OP5TEW4BMS5BWPLDLGSBAYIV33DGKID7QQFIATEZESGKA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.646075894 (52h29m12.60517313s) [noise=true , address=104.36.82.22:4540 , piece_id=VIXXCDDFSEXUK67QYNNIY4BQGX525BENSQMRF4BKSI2TMBQWNL7A, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.735202745 (52h29m12.69429999s) [noise=true , address=104.36.82.58:4297 , piece_id=WPNST3GDCU64MOHMI6VH4HQSJ245REOYJBYFWUIYBTIHCQH6SVBA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849172178 (52h29m12.808269418s) [noise=true , address=64.49.13.155:4923 , piece_id=F7YCBZXX4XYFNLEWHPCB7MMITY2ZENA2DJBNOU56TJAEIA4E7RAA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: <nil>
Aug 10 21:54:50.849211617 (52h29m12.808308862s) [seg_pos={0 0}, upload=54690]: Segment reached optimal threshold of 14 pieces.
Aug 10 21:54:50.849449987 (52h29m12.808547232s) [noise=true , address=79.127.205.233:4633 , piece_id=VLQZGFZEHZG25TWU4A2HXJAA76KK22BG2USQ2FNVTLOZEZQKA77Q, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849549059 (52h29m12.808646297s) [noise=true , address=64.49.13.154:4928 , piece_id=P5B2K6MQL5EDBPJXJPH2R7TRJVR4BG7ORMOPLMCYBIHZSN5PQMNA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 21:54:50.849653857 (52h29m12.808751088s) [noise=true , address=104.36.82.17:4356 , piece_id=X33F56M7WPL3V4NNXNKVNS6TXGGIPFE6IATDTD2PUIIIBEM5DTYA, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15QSJs47N4rSvAqkMdkc7d1TngEjd4aWhY1pDr7kxwogqeZK2q): protocol: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38508->104.36.82.17:4356: use of closed network connection
Aug 10 21:54:50.849701519 (52h29m12.808798765s) [noise=true , address=104.36.82.16:4323 , piece_id=PCLRKBLP57P3PB3EPYILM27S7LUODSVOIS5S63HDNM2ML4EGABKQ, seg_pos={0 0}, upload=54690]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1meb5uwbGA8toEsGhaZxSqj4rh6TRWtCM8gD5PxmTh57BLJYaS): protocol: read tcp 139.59.144.22:57414->104.36.82.16:4323: use of closed network connection; context canceled
Aug 10 21:54:50.849736637 (52h29m12.808833876s) [seg_pos={0 0}, upload=54690]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 21:54:50.849824879 (52h29m12.808922127s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 21:54:50.849830297 (52h29m12.808927543s) [upload=54690]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 21:54:51.011403787 (52h29m12.970501023s) [upload=54690]: Done uploading segments...
Aug 10 21:54:51.011436253 (52h29m12.970533488s) [upload=54690]: Upload finished. err: <nil>
Duration: 2.069537803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.655062466s
FAIL (2025-08-10 21:53:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.655096292s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.........................X................................] duration:
848.126883ms
FAIL (2025-08-10 21:53:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.179823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.628620245s
FAIL (2025-08-10 21:53:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.628645792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.X.........................X...............................] duration:
849.072432ms
FAIL (2025-08-10 21:52:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.107149ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
3.085322314s
FAIL (2025-08-10 21:52:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.085358961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.X.........................X..............................] duration:
886.842721ms
FAIL (2025-08-10 21:52:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 886.887185ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
3.153913125s
FAIL (2025-08-10 21:51:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.153942357s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.X.X.........................X.............................] duration:
853.865994ms
FAIL (2025-08-10 21:51:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.89705ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.561750943s
FAIL (2025-08-10 21:50:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.56178239s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.X.X.........................X............................] duration:
873.009704ms
FAIL (2025-08-10 21:50:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.061841ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.X.X.........................X...........................] duration:
841.988341ms
FAIL (2025-08-10 21:50:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.016613ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.573679251s
FAIL (2025-08-10 21:49:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.573712631s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.X.X.........................X..........................] duration:
972.143267ms
FAIL (2025-08-10 21:49:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 972.175249ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.554251875s
FAIL (2025-08-10 21:49:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.554315679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.X.X.........................X.........................] duration:
863.973011ms
FAIL (2025-08-10 21:48:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.006014ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.533589958s
FAIL (2025-08-10 21:48:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.533622638s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.708804271s
FAIL (2025-08-10 21:48:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.708848612s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.X.X.........................X........................] duration:
1.109861576s
FAIL (2025-08-10 21:47:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.109954233s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
3.097617516s
FAIL (2025-08-10 21:47:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.097660646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.X.X.........................X.......................] duration:
817.352795ms
FAIL (2025-08-10 21:46:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.380531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.153224381s
FAIL (2025-08-10 21:46:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.153311345s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.X.X.........................X......................] duration:
857.349239ms
FAIL (2025-08-10 21:45:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.376408ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.581391758s
FAIL (2025-08-10 21:45:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.581421514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.89826647s
FAIL (2025-08-10 21:44:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.898361073s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.X.X.........................X.....................] duration:
880.692618ms
FAIL (2025-08-10 21:44:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.723597ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.X.X.........................X....................] duration:
856.068037ms
FAIL (2025-08-10 21:44:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.147585ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.X.X.........................X...................] duration:
907.016778ms
FAIL (2025-08-10 21:44:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.049747ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.887310436s
FAIL (2025-08-10 21:43:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.887351594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.X.X.........................X..................] duration:
856.513285ms
FAIL (2025-08-10 21:43:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.538749ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
3.012136001s
FAIL (2025-08-10 21:42:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.012165368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.X.X.........................X.................] duration:
890.862269ms
FAIL (2025-08-10 21:42:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.96764ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.128358361s
FAIL (2025-08-10 21:41:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.128402259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.X.X.........................X................] duration:
1.080617896s
FAIL (2025-08-10 21:41:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.080663906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.962334674s
FAIL (2025-08-10 21:40:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:25:22.647268985 (51h59m44.606366238s) [upload=54178]: Starting upload Aug 10 21:25:22.647354501 (51h59m44.606451741s) [upload=54178]: Done starting upload Aug 10 21:25:22.647491174 (51h59m44.60658841s) [upload=54178]: Uploading segments... Aug 10 21:25:22.647980708 (51h59m44.607077971s) [upload=54178]: Got next segment. Inline: false Aug 10 21:25:22.648036769 (51h59m44.607134s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:25:22.648052995 (51h59m44.60715024s) [upload=54178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 21:25:22.736083146 (51h59m44.695180398s) [upload=54178]: Next segment err: metaclient: Too Many Requests Aug 10 21:25:22.736132039 (51h59m44.695229285s) [upload=54178]: Done uploading segments... Aug 10 21:25:22.736152743 (51h59m44.69524999s) [upload=54178]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.962370343s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.X.X.........................X...............] duration:
902.585757ms
FAIL (2025-08-10 21:40:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.609604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.X.X.........................X..............] duration:
879.166382ms
FAIL (2025-08-10 21:39:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 21:30:02.724814895 (52h4m24.683912168s) [upload=54261]: Starting upload Aug 10 21:30:02.724942886 (52h4m24.684040134s) [upload=54261]: Done starting upload Aug 10 21:30:02.725075393 (52h4m24.684172655s) [upload=54261]: Uploading segments... Aug 10 21:30:02.725171458 (52h4m24.684268719s) [upload=54261]: Got next segment. Inline: true Aug 10 21:30:02.725179757 (52h4m24.684277025s) [upload=54261]: Waiting for error group managing segments... Aug 10 21:30:02.725255653 (52h4m24.684352906s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 21:30:02.725261947 (52h4m24.684359207s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 21:30:02.725266011 (52h4m24.684363258s) [upload=54261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 21:30:02.813773590 (52h4m24.77287085s) [upload=54261]: Done uploading segments... Aug 10 21:30:02.813814561 (52h4m24.772911814s) [upload=54261]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.191951ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|