Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.925892668s
FAIL (2025-08-10 20:14:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.925928152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.019451912s
FAIL (2025-08-10 20:14:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.019550785s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
930.760021ms
FAIL (2025-08-10 20:14:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 930.809188ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.644315278s
FAIL (2025-08-10 20:14:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.644341602s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.705795833s
FAIL (2025-08-10 20:13:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.705819475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.695952381s
FAIL (2025-08-10 20:13:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.695993628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
970.757458ms
FAIL (2025-08-10 20:13:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 970.785201ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.596795138s
FAIL (2025-08-10 20:12:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.596827514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
959.256756ms
FAIL (2025-08-10 20:12:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 959.284801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.135835149s
FAIL (2025-08-10 20:11:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.135863392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
3.309529403s
FAIL (2025-08-10 20:11:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 3.309559037s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
837.282876ms
FAIL (2025-08-10 20:10:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.316701ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.993481417s
FAIL (2025-08-10 20:10:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.993513309s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.785336008s
FAIL (2025-08-10 20:10:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.785368757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
870.680735ms
FAIL (2025-08-10 20:09:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.796629ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.429517894s
FAIL (2025-08-10 20:09:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.429547718s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.869201759s
FAIL (2025-08-10 20:09:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.869224963s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
844.308648ms
FAIL (2025-08-10 20:08:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.339361ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.549247078s
FAIL (2025-08-10 20:08:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.549274656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.033582394s
FAIL (2025-08-10 20:08:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.033616323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...............................................X...........] duration:
3.149008914s
FAIL (2025-08-10 20:07:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 3.149044473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
849.907594ms
FAIL (2025-08-10 20:06:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.931974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...............................................X..........] duration:
3.102409686s
FAIL (2025-08-10 20:06:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 3.102442025s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.120324931s
FAIL (2025-08-10 20:06:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.120356096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
890.202977ms
FAIL (2025-08-10 20:05:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.238365ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...............................................X.........] duration:
2.710131157s
FAIL (2025-08-10 20:05:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.710175628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.086192797s
FAIL (2025-08-10 20:05:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.086248932s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
950.964743ms
FAIL (2025-08-10 20:04:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 950.991104ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...............................................X........] duration:
2.970607879s
FAIL (2025-08-10 20:04:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.970635417s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...............................................X.......] duration:
2.72519004s
FAIL (2025-08-10 20:03:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.725222298s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
862.947015ms
FAIL (2025-08-10 20:03:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.978033ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
917.497789ms
FAIL (2025-08-10 20:03:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 917.547337ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................................X......] duration:
3.314237298s
FAIL (2025-08-10 20:02:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 3.31426292s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.209782656s
FAIL (2025-08-10 20:02:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.209814383s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...............................................X.....] duration:
3.118908202s
FAIL (2025-08-10 20:02:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 3.118944315s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...............................................X....] duration:
2.798543044s
FAIL (2025-08-10 20:02:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.798573076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
839.552082ms
FAIL (2025-08-10 20:01:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.585731ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...............................................X...] duration:
2.974904489s
FAIL (2025-08-10 20:01:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.974950978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........X...............................................X..] duration:
2.428726383s
FAIL (2025-08-10 20:00:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.428761033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
828.661751ms
FAIL (2025-08-10 20:00:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.694883ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........X...............................................X.] duration:
2.843121488s
FAIL (2025-08-10 20:00:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 2.843156052s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X........X...............................................X] duration:
1.690494423s
FAIL (2025-08-10 19:59:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 19:59:53.316256399 (50h34m15.275353647s) [upload=52713]: Starting upload
Aug 10 19:59:53.316311475 (50h34m15.275408719s) [upload=52713]: Done starting upload
Aug 10 19:59:53.316421141 (50h34m15.275518372s) [upload=52713]: Uploading segments...
Aug 10 19:59:53.316735799 (50h34m15.275833044s) [upload=52713]: Got next segment. Inline: false
Aug 10 19:59:53.316765901 (50h34m15.275863132s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:59:53.316770194 (50h34m15.275867425s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:59:53.518161319 (50h34m15.477258637s) [seg_pos={0 0}, upload=52713]: Begin upload segment...
Aug 10 19:59:53.518256099 (50h34m15.477353332s) [seg_pos={0 0}, upload=52713]: Done begin upload segment.
Aug 10 19:59:53.518293174 (50h34m15.47739042s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518339220 (50h34m15.477436468s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518738679 (50h34m15.477835927s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.518879076 (50h34m15.477976332s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519291093 (50h34m15.478388339s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.519648961 (50h34m15.478746212s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520002991 (50h34m15.479100239s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520369862 (50h34m15.47946711s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.520754941 (50h34m15.479852188s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521124836 (50h34m15.480222088s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521469920 (50h34m15.480567168s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.521802940 (50h34m15.480900194s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522153915 (50h34m15.481251161s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522477412 (50h34m15.48157466s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.522785724 (50h34m15.481882989s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523187311 (50h34m15.482284558s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523488267 (50h34m15.482585512s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:53.523778182 (50h34m15.482875419s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Uploading piece...
Aug 10 19:59:54.066960101 (50h34m16.026057339s) [upload=52713]: Next returned nil segment
Aug 10 19:59:54.066990972 (50h34m16.026088218s) [upload=52713]: Waiting for error group managing segments...
Aug 10 19:59:54.257272378 (50h34m16.216369624s) [noise=true , address=45.91.116.9:4286 , piece_id=5A3UN5IJTWNKP2SU52T4SYQ4LBEA3ZEFZP3IFCCE6JHXDMH4A2EA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.257977204 (50h34m16.217074453s) [noise=true , address=104.36.82.11:4146 , piece_id=QWCSWG5R7KQ5NUJTEPXRNDGRUVOYKF53WR4XB7W46WNPDGJLQ5CQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.258342205 (50h34m16.217439442s) [noise=true , address=104.36.82.17:4338 , piece_id=3VG3DBH7M7YALYO5M23HPKNKMRPYCVTWCZ6KGWNOAJF6XSA24ZIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.259405972 (50h34m16.218503204s) [noise=true , address=104.36.82.37:4664 , piece_id=V7VX7V2M6MVOABJI7GJZUS4O7KPK2LRYCSXXHBUUICGMMNNVSGTQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266173239 (50h34m16.225270474s) [noise=true , address=104.36.82.45:4940 , piece_id=BO3YWAFCTVNAU2NTNTTNQWAW7XFTEUFQOF2TLRLODWDJO7C73UZQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.266960378 (50h34m16.226057609s) [noise=true , address=104.36.82.15:4260 , piece_id=ULBWZOAW5ZCI5SX4FDKLXOKYYWMF7LS2VDUG7JIIN6FF6H5A6G6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.275186479 (50h34m16.234283717s) [noise=true , address=104.36.82.44:4883 , piece_id=TU54UO5YYI3DKZJBZG5A7F5EIPEWFG5AG5EE2HTK4E4MTDZNWFDQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.283691912 (50h34m16.242789144s) [noise=true , address=104.36.82.22:4513 , piece_id=HBBUFUPJDCCO6S6TIUGPCKMK6XRMJKIHVFNEEXAJPQK7IEFTEZSA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.289044281 (50h34m16.248141521s) [noise=true , address=104.36.82.16:4323 , piece_id=GEFGCH44ECSGDLKHWA5LOST5OWKKFY52ZLKEEWHCTBMH4T5FE6IA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.295043850 (50h34m16.25414109s) [noise=true , address=104.36.82.43:4854 , piece_id=JRBUY3RTXFLIFZB5KH6UYILVUTUHY263S6M6R2OESVC23EGBVQCQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.300231295 (50h34m16.259328528s) [noise=true , address=104.36.82.34:4565 , piece_id=OJJW7VWHE5ZFIDIS43SBUGK5QLTT4BZGH2VNE5Y2L4OB2D535VPA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.311778995 (50h34m16.270876239s) [noise=true , address=104.36.82.35:4598 , piece_id=IH4N2H3MWGS5T3CTXBE2Q4JYKUBGAQEOFGS6MKQL324CW47FWEUQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.318691563 (50h34m16.277788795s) [noise=true , address=45.91.116.9:4288 , piece_id=JCL7KGYLUA34SQJJFNDP72F7Y42PXJQMCDFUD2EYKNM5SJIG2AQQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340701154 (50h34m16.299798386s) [noise=true , address=104.36.82.9:4015 , piece_id=2TWXFAQXNAWO7ADNS7JC2RXZ3QG7ZWW5J7VWM4MQNYLUND3KSCIA, seg_pos={0 0}, upload=52713]: Done uploading piece. err: <nil>
Aug 10 19:59:54.340753115 (50h34m16.299850372s) [seg_pos={0 0}, upload=52713]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:59:54.341091591 (50h34m16.300188837s) [noise=true , address=104.36.82.5:4844 , piece_id=6LD4H4BXQDT7DDL4QUGSW6QSCN53AAJ6T3YPTXNYY2G2WXWDZWJQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42120->104.36.82.5:4844: use of closed network connection
Aug 10 19:59:54.341241693 (50h34m16.300338938s) [noise=true , address=104.36.82.18:4398 , piece_id=Z5GTPZU3IXOBEBDKSRQ3PM7NQFZX7IXVSKFM3MM4DZWTQU7ZFI3Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bVyGrTCBshM9ki9XkbukNpcEWzhajZebyvjbPjnhSewZraMjr): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341418585 (50h34m16.30051583s) [noise=true , address=64.49.13.26:4955 , piece_id=CWOEFXTKKMCENHAIBO3VXK4CM4YGEFNMUYMWSWUX525KENW5PA6Q, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125TV3v1CzV1Q9TPfyVHsn26NZ5XcHixKxA66t96iz62FF4SHAP): protocol: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34702->64.49.13.26:4955: use of closed network connection
Aug 10 19:59:54.341546137 (50h34m16.300643383s) [noise=true , address=104.36.82.60:4351 , piece_id=O647MVDAAPRCAEUIQKXGABKJCPN2NCBMGAWAEXM4IXAQAJMNA2NQ, seg_pos={0 0}, upload=52713]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg): protocol: expected piece hash; context canceled; EOF
Aug 10 19:59:54.341584874 (50h34m16.300682126s) [seg_pos={0 0}, upload=52713]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:59:54.341679592 (50h34m16.300776826s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:59:54.341684946 (50h34m16.300782191s) [upload=52713]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:59:54.508897714 (50h34m16.467994951s) [upload=52713]: Done uploading segments...
Aug 10 19:59:54.508918010 (50h34m16.46801525s) [upload=52713]: Upload finished. err: <nil>
Duration: 1.690521081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
866.258174ms
FAIL (2025-08-10 19:59:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.427596ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X........X...............................................] duration:
3.123236103s
FAIL (2025-08-10 19:59:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 19:21:59.897368867 (49h56m21.856466105s) [upload=52054]: Starting upload
Aug 10 19:21:59.897441043 (49h56m21.85653829s) [upload=52054]: Done starting upload
Aug 10 19:21:59.897534625 (49h56m21.856631861s) [upload=52054]: Uploading segments...
Aug 10 19:21:59.897864664 (49h56m21.856961899s) [upload=52054]: Got next segment. Inline: false
Aug 10 19:21:59.897939045 (49h56m21.857036289s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:21:59.897944486 (49h56m21.857041731s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:22:00.105814937 (49h56m22.064912189s) [seg_pos={0 0}, upload=52054]: Begin upload segment...
Aug 10 19:22:00.105896237 (49h56m22.064993473s) [seg_pos={0 0}, upload=52054]: Done begin upload segment.
Aug 10 19:22:00.105969079 (49h56m22.065066359s) [noise=true , address=104.36.82.61:4405 , piece_id=AYNPZ4PEBMSHVN7WNBNDW4BQKYJKLIHC4KGKGV5OIF7TC2H66CDA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.105993591 (49h56m22.065090847s) [noise=true , address=104.36.82.37:4661 , piece_id=JLLY2FHKBEILZR2YDARVQAL66E26RLRPNWINUSJHUOC44CDIZVKQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106067737 (49h56m22.065164975s) [noise=true , address=104.36.82.18:4393 , piece_id=I2NC7OSY7DQX7OX2C3Z6TTI23RYWYMTAIWAKKALLTMEWM2JGS5HQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106455172 (49h56m22.065552419s) [noise=true , address=64.49.13.139:4469 , piece_id=BXX6AULDXZZS2PEJ4U56AT3BN3CXBXMK3EYFFBATVPHLO4CUEA7A, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106461944 (49h56m22.065559201s) [noise=true , address=104.36.82.44:4875 , piece_id=665TS4C7IAPAC3M7V3H54JTOZ6AQV2MTB43VL5X5VELTAQLFOEOA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106982176 (49h56m22.066079413s) [noise=true , address=104.36.82.58:4282 , piece_id=IAABEON2O7JRYNX6YKEJBIYPCQID47MDUT2FVG5AU73IYMW2ONIA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107056447 (49h56m22.066153694s) [noise=true , address=104.36.82.17:4329 , piece_id=5ATNY2BF4WTMAJDSFHI5ATXSW7ILMXAZVGLHMAE2GK65IWECCPFA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107300789 (49h56m22.066398044s) [noise=true , address=104.36.82.62:4431 , piece_id=CRW7TYSVKA3I5G2TVBWKM46UJ5EKKNOIPGUM242IBUS6EHRI3WSA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107408821 (49h56m22.066506067s) [noise=true , address=64.49.13.169:4707 , piece_id=NZRANY6NWELSKVGK3VMBACMM3XODE2Z2TTQOFHOQTB3JPDVJKZSA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107615402 (49h56m22.066712638s) [noise=true , address=104.36.82.46:4510 , piece_id=YWC4I6DCCKZXJZLIRWLWKVG3M247JQFWA4H57AG6RL4YRLHSWVGQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107764975 (49h56m22.06686223s) [noise=true , address=104.36.82.20:4457 , piece_id=TKINQ5KGXBVJSGM62HYK6AZWQY6W3PACYLR3DE46JGB3Q6TCPLJQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107924629 (49h56m22.067021875s) [noise=true , address=104.36.82.43:4841 , piece_id=FAKFYFL6QX25PHAA7R3S32TQERHBS6EZ4F4ZBAGOVOR32BCXFFDA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.108195766 (49h56m22.067293015s) [noise=true , address=104.36.82.8:4982 , piece_id=WVIOWXQKT65ITFYIJB6XHRYL2ZCZP2JXCYTK5JYSFEWAVOYIWIVQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.110246901 (49h56m22.06934415s) [noise=true , address=104.36.82.36:4644 , piece_id=CB3QLV4INCRQESJNF5JFY2UU76GJHVZG6VM6EXAW6CERU5SOEADQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.110891096 (49h56m22.069988348s) [noise=true , address=79.127.201.215:4354 , piece_id=GX2OZJFKRFBQ5HPRAGYBBLPOU7MASVXPPLF643BKKJ4H7VLQBSGQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.111280002 (49h56m22.070377247s) [noise=true , address=104.36.82.39:4733 , piece_id=K5YSA32PQQ327J2JG6YW4HEEPAWXJB656LTJYO5HBBC7KKO2FLUQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.112159417 (49h56m22.071256673s) [noise=true , address=79.127.219.48:4076 , piece_id=DDQEQAIOHUSE5LGPBQRL64DZMB6WL5BAOUOSBQSDW63UNVDU3P2Q, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.113279988 (49h56m22.072377244s) [noise=true , address=45.91.116.4:4962 , piece_id=OE4PVRIIUC6AJW2UMZ2HVI6RAY5IBFBYGA7ISM4VNEYULVYI3LOQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.685302477 (49h56m22.644399708s) [upload=52054]: Next returned nil segment
Aug 10 19:22:00.685328264 (49h56m22.644425509s) [upload=52054]: Waiting for error group managing segments...
Aug 10 19:22:00.847262091 (49h56m22.806359336s) [noise=true , address=104.36.82.43:4841 , piece_id=FAKFYFL6QX25PHAA7R3S32TQERHBS6EZ4F4ZBAGOVOR32BCXFFDA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.849857330 (49h56m22.808954569s) [noise=true , address=79.127.219.48:4076 , piece_id=DDQEQAIOHUSE5LGPBQRL64DZMB6WL5BAOUOSBQSDW63UNVDU3P2Q, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.855788335 (49h56m22.814885566s) [noise=true , address=104.36.82.20:4457 , piece_id=TKINQ5KGXBVJSGM62HYK6AZWQY6W3PACYLR3DE46JGB3Q6TCPLJQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.859390091 (49h56m22.818487334s) [noise=true , address=104.36.82.18:4393 , piece_id=I2NC7OSY7DQX7OX2C3Z6TTI23RYWYMTAIWAKKALLTMEWM2JGS5HQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.860997011 (49h56m22.820094241s) [noise=true , address=45.91.116.4:4962 , piece_id=OE4PVRIIUC6AJW2UMZ2HVI6RAY5IBFBYGA7ISM4VNEYULVYI3LOQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.871863323 (49h56m22.83096056s) [noise=true , address=104.36.82.37:4661 , piece_id=JLLY2FHKBEILZR2YDARVQAL66E26RLRPNWINUSJHUOC44CDIZVKQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.874233943 (49h56m22.83333118s) [noise=true , address=104.36.82.36:4644 , piece_id=CB3QLV4INCRQESJNF5JFY2UU76GJHVZG6VM6EXAW6CERU5SOEADQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.891689130 (49h56m22.850786367s) [noise=true , address=104.36.82.61:4405 , piece_id=AYNPZ4PEBMSHVN7WNBNDW4BQKYJKLIHC4KGKGV5OIF7TC2H66CDA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.959335211 (49h56m22.918432449s) [noise=true , address=104.36.82.44:4875 , piece_id=665TS4C7IAPAC3M7V3H54JTOZ6AQV2MTB43VL5X5VELTAQLFOEOA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.043521563 (49h56m23.002618801s) [noise=true , address=104.36.82.62:4431 , piece_id=CRW7TYSVKA3I5G2TVBWKM46UJ5EKKNOIPGUM242IBUS6EHRI3WSA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.046956969 (49h56m23.006054204s) [noise=true , address=104.36.82.39:4733 , piece_id=K5YSA32PQQ327J2JG6YW4HEEPAWXJB656LTJYO5HBBC7KKO2FLUQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.080041951 (49h56m23.039139183s) [noise=true , address=104.36.82.17:4329 , piece_id=5ATNY2BF4WTMAJDSFHI5ATXSW7ILMXAZVGLHMAE2GK65IWECCPFA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.130487784 (49h56m23.08958502s) [noise=true , address=79.127.201.215:4354 , piece_id=GX2OZJFKRFBQ5HPRAGYBBLPOU7MASVXPPLF643BKKJ4H7VLQBSGQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.184669780 (49h56m23.143767026s) [noise=true , address=104.36.82.8:4982 , piece_id=WVIOWXQKT65ITFYIJB6XHRYL2ZCZP2JXCYTK5JYSFEWAVOYIWIVQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.184715687 (49h56m23.143812934s) [seg_pos={0 0}, upload=52054]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:22:01.184926700 (49h56m23.144023946s) [noise=true , address=104.36.82.58:4282 , piece_id=IAABEON2O7JRYNX6YKEJBIYPCQID47MDUT2FVG5AU73IYMW2ONIA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TcjEH1aW5iW3t2LmMMbn6CCjR5W9cyVDhALoTTmoPtMCFNB5G): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185033963 (49h56m23.144131211s) [noise=true , address=64.49.13.169:4707 , piece_id=NZRANY6NWELSKVGK3VMBACMM3XODE2Z2TTQOFHOQTB3JPDVJKZSA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185291418 (49h56m23.14438867s) [noise=true , address=64.49.13.139:4469 , piece_id=BXX6AULDXZZS2PEJ4U56AT3BN3CXBXMK3EYFFBATVPHLO4CUEA7A, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185343345 (49h56m23.144440591s) [noise=true , address=104.36.82.46:4510 , piece_id=YWC4I6DCCKZXJZLIRWLWKVG3M247JQFWA4H57AG6RL4YRLHSWVGQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185406977 (49h56m23.144504223s) [seg_pos={0 0}, upload=52054]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:22:01.185576570 (49h56m23.14467382s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:22:01.185585381 (49h56m23.144682628s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:22:01.350824858 (49h56m23.309922113s) [upload=52054]: Done uploading segments...
Aug 10 19:22:01.350851807 (49h56m23.309949055s) [upload=52054]: Upload finished. err: <nil>
Duration: 3.123268456s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
886.770255ms
FAIL (2025-08-10 19:59:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 886.795799ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
842.928366ms
FAIL (2025-08-10 19:58:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.975026ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X........X..............................................] duration:
2.506536515s
FAIL (2025-08-10 19:58:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 19:21:59.897368867 (49h56m21.856466105s) [upload=52054]: Starting upload
Aug 10 19:21:59.897441043 (49h56m21.85653829s) [upload=52054]: Done starting upload
Aug 10 19:21:59.897534625 (49h56m21.856631861s) [upload=52054]: Uploading segments...
Aug 10 19:21:59.897864664 (49h56m21.856961899s) [upload=52054]: Got next segment. Inline: false
Aug 10 19:21:59.897939045 (49h56m21.857036289s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:21:59.897944486 (49h56m21.857041731s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:22:00.105814937 (49h56m22.064912189s) [seg_pos={0 0}, upload=52054]: Begin upload segment...
Aug 10 19:22:00.105896237 (49h56m22.064993473s) [seg_pos={0 0}, upload=52054]: Done begin upload segment.
Aug 10 19:22:00.105969079 (49h56m22.065066359s) [noise=true , address=104.36.82.61:4405 , piece_id=AYNPZ4PEBMSHVN7WNBNDW4BQKYJKLIHC4KGKGV5OIF7TC2H66CDA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.105993591 (49h56m22.065090847s) [noise=true , address=104.36.82.37:4661 , piece_id=JLLY2FHKBEILZR2YDARVQAL66E26RLRPNWINUSJHUOC44CDIZVKQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106067737 (49h56m22.065164975s) [noise=true , address=104.36.82.18:4393 , piece_id=I2NC7OSY7DQX7OX2C3Z6TTI23RYWYMTAIWAKKALLTMEWM2JGS5HQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106455172 (49h56m22.065552419s) [noise=true , address=64.49.13.139:4469 , piece_id=BXX6AULDXZZS2PEJ4U56AT3BN3CXBXMK3EYFFBATVPHLO4CUEA7A, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106461944 (49h56m22.065559201s) [noise=true , address=104.36.82.44:4875 , piece_id=665TS4C7IAPAC3M7V3H54JTOZ6AQV2MTB43VL5X5VELTAQLFOEOA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106982176 (49h56m22.066079413s) [noise=true , address=104.36.82.58:4282 , piece_id=IAABEON2O7JRYNX6YKEJBIYPCQID47MDUT2FVG5AU73IYMW2ONIA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107056447 (49h56m22.066153694s) [noise=true , address=104.36.82.17:4329 , piece_id=5ATNY2BF4WTMAJDSFHI5ATXSW7ILMXAZVGLHMAE2GK65IWECCPFA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107300789 (49h56m22.066398044s) [noise=true , address=104.36.82.62:4431 , piece_id=CRW7TYSVKA3I5G2TVBWKM46UJ5EKKNOIPGUM242IBUS6EHRI3WSA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107408821 (49h56m22.066506067s) [noise=true , address=64.49.13.169:4707 , piece_id=NZRANY6NWELSKVGK3VMBACMM3XODE2Z2TTQOFHOQTB3JPDVJKZSA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107615402 (49h56m22.066712638s) [noise=true , address=104.36.82.46:4510 , piece_id=YWC4I6DCCKZXJZLIRWLWKVG3M247JQFWA4H57AG6RL4YRLHSWVGQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107764975 (49h56m22.06686223s) [noise=true , address=104.36.82.20:4457 , piece_id=TKINQ5KGXBVJSGM62HYK6AZWQY6W3PACYLR3DE46JGB3Q6TCPLJQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107924629 (49h56m22.067021875s) [noise=true , address=104.36.82.43:4841 , piece_id=FAKFYFL6QX25PHAA7R3S32TQERHBS6EZ4F4ZBAGOVOR32BCXFFDA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.108195766 (49h56m22.067293015s) [noise=true , address=104.36.82.8:4982 , piece_id=WVIOWXQKT65ITFYIJB6XHRYL2ZCZP2JXCYTK5JYSFEWAVOYIWIVQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.110246901 (49h56m22.06934415s) [noise=true , address=104.36.82.36:4644 , piece_id=CB3QLV4INCRQESJNF5JFY2UU76GJHVZG6VM6EXAW6CERU5SOEADQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.110891096 (49h56m22.069988348s) [noise=true , address=79.127.201.215:4354 , piece_id=GX2OZJFKRFBQ5HPRAGYBBLPOU7MASVXPPLF643BKKJ4H7VLQBSGQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.111280002 (49h56m22.070377247s) [noise=true , address=104.36.82.39:4733 , piece_id=K5YSA32PQQ327J2JG6YW4HEEPAWXJB656LTJYO5HBBC7KKO2FLUQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.112159417 (49h56m22.071256673s) [noise=true , address=79.127.219.48:4076 , piece_id=DDQEQAIOHUSE5LGPBQRL64DZMB6WL5BAOUOSBQSDW63UNVDU3P2Q, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.113279988 (49h56m22.072377244s) [noise=true , address=45.91.116.4:4962 , piece_id=OE4PVRIIUC6AJW2UMZ2HVI6RAY5IBFBYGA7ISM4VNEYULVYI3LOQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.685302477 (49h56m22.644399708s) [upload=52054]: Next returned nil segment
Aug 10 19:22:00.685328264 (49h56m22.644425509s) [upload=52054]: Waiting for error group managing segments...
Aug 10 19:22:00.847262091 (49h56m22.806359336s) [noise=true , address=104.36.82.43:4841 , piece_id=FAKFYFL6QX25PHAA7R3S32TQERHBS6EZ4F4ZBAGOVOR32BCXFFDA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.849857330 (49h56m22.808954569s) [noise=true , address=79.127.219.48:4076 , piece_id=DDQEQAIOHUSE5LGPBQRL64DZMB6WL5BAOUOSBQSDW63UNVDU3P2Q, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.855788335 (49h56m22.814885566s) [noise=true , address=104.36.82.20:4457 , piece_id=TKINQ5KGXBVJSGM62HYK6AZWQY6W3PACYLR3DE46JGB3Q6TCPLJQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.859390091 (49h56m22.818487334s) [noise=true , address=104.36.82.18:4393 , piece_id=I2NC7OSY7DQX7OX2C3Z6TTI23RYWYMTAIWAKKALLTMEWM2JGS5HQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.860997011 (49h56m22.820094241s) [noise=true , address=45.91.116.4:4962 , piece_id=OE4PVRIIUC6AJW2UMZ2HVI6RAY5IBFBYGA7ISM4VNEYULVYI3LOQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.871863323 (49h56m22.83096056s) [noise=true , address=104.36.82.37:4661 , piece_id=JLLY2FHKBEILZR2YDARVQAL66E26RLRPNWINUSJHUOC44CDIZVKQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.874233943 (49h56m22.83333118s) [noise=true , address=104.36.82.36:4644 , piece_id=CB3QLV4INCRQESJNF5JFY2UU76GJHVZG6VM6EXAW6CERU5SOEADQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.891689130 (49h56m22.850786367s) [noise=true , address=104.36.82.61:4405 , piece_id=AYNPZ4PEBMSHVN7WNBNDW4BQKYJKLIHC4KGKGV5OIF7TC2H66CDA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.959335211 (49h56m22.918432449s) [noise=true , address=104.36.82.44:4875 , piece_id=665TS4C7IAPAC3M7V3H54JTOZ6AQV2MTB43VL5X5VELTAQLFOEOA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.043521563 (49h56m23.002618801s) [noise=true , address=104.36.82.62:4431 , piece_id=CRW7TYSVKA3I5G2TVBWKM46UJ5EKKNOIPGUM242IBUS6EHRI3WSA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.046956969 (49h56m23.006054204s) [noise=true , address=104.36.82.39:4733 , piece_id=K5YSA32PQQ327J2JG6YW4HEEPAWXJB656LTJYO5HBBC7KKO2FLUQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.080041951 (49h56m23.039139183s) [noise=true , address=104.36.82.17:4329 , piece_id=5ATNY2BF4WTMAJDSFHI5ATXSW7ILMXAZVGLHMAE2GK65IWECCPFA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.130487784 (49h56m23.08958502s) [noise=true , address=79.127.201.215:4354 , piece_id=GX2OZJFKRFBQ5HPRAGYBBLPOU7MASVXPPLF643BKKJ4H7VLQBSGQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.184669780 (49h56m23.143767026s) [noise=true , address=104.36.82.8:4982 , piece_id=WVIOWXQKT65ITFYIJB6XHRYL2ZCZP2JXCYTK5JYSFEWAVOYIWIVQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.184715687 (49h56m23.143812934s) [seg_pos={0 0}, upload=52054]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:22:01.184926700 (49h56m23.144023946s) [noise=true , address=104.36.82.58:4282 , piece_id=IAABEON2O7JRYNX6YKEJBIYPCQID47MDUT2FVG5AU73IYMW2ONIA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TcjEH1aW5iW3t2LmMMbn6CCjR5W9cyVDhALoTTmoPtMCFNB5G): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185033963 (49h56m23.144131211s) [noise=true , address=64.49.13.169:4707 , piece_id=NZRANY6NWELSKVGK3VMBACMM3XODE2Z2TTQOFHOQTB3JPDVJKZSA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185291418 (49h56m23.14438867s) [noise=true , address=64.49.13.139:4469 , piece_id=BXX6AULDXZZS2PEJ4U56AT3BN3CXBXMK3EYFFBATVPHLO4CUEA7A, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185343345 (49h56m23.144440591s) [noise=true , address=104.36.82.46:4510 , piece_id=YWC4I6DCCKZXJZLIRWLWKVG3M247JQFWA4H57AG6RL4YRLHSWVGQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185406977 (49h56m23.144504223s) [seg_pos={0 0}, upload=52054]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:22:01.185576570 (49h56m23.14467382s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:22:01.185585381 (49h56m23.144682628s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:22:01.350824858 (49h56m23.309922113s) [upload=52054]: Done uploading segments...
Aug 10 19:22:01.350851807 (49h56m23.309949055s) [upload=52054]: Upload finished. err: <nil>
Duration: 2.50663145s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
864.471812ms
FAIL (2025-08-10 19:57:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.495659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X........X.............................................] duration:
2.750800825s
FAIL (2025-08-10 19:57:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 19:21:59.897368867 (49h56m21.856466105s) [upload=52054]: Starting upload
Aug 10 19:21:59.897441043 (49h56m21.85653829s) [upload=52054]: Done starting upload
Aug 10 19:21:59.897534625 (49h56m21.856631861s) [upload=52054]: Uploading segments...
Aug 10 19:21:59.897864664 (49h56m21.856961899s) [upload=52054]: Got next segment. Inline: false
Aug 10 19:21:59.897939045 (49h56m21.857036289s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 19:21:59.897944486 (49h56m21.857041731s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 19:22:00.105814937 (49h56m22.064912189s) [seg_pos={0 0}, upload=52054]: Begin upload segment...
Aug 10 19:22:00.105896237 (49h56m22.064993473s) [seg_pos={0 0}, upload=52054]: Done begin upload segment.
Aug 10 19:22:00.105969079 (49h56m22.065066359s) [noise=true , address=104.36.82.61:4405 , piece_id=AYNPZ4PEBMSHVN7WNBNDW4BQKYJKLIHC4KGKGV5OIF7TC2H66CDA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.105993591 (49h56m22.065090847s) [noise=true , address=104.36.82.37:4661 , piece_id=JLLY2FHKBEILZR2YDARVQAL66E26RLRPNWINUSJHUOC44CDIZVKQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106067737 (49h56m22.065164975s) [noise=true , address=104.36.82.18:4393 , piece_id=I2NC7OSY7DQX7OX2C3Z6TTI23RYWYMTAIWAKKALLTMEWM2JGS5HQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106455172 (49h56m22.065552419s) [noise=true , address=64.49.13.139:4469 , piece_id=BXX6AULDXZZS2PEJ4U56AT3BN3CXBXMK3EYFFBATVPHLO4CUEA7A, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106461944 (49h56m22.065559201s) [noise=true , address=104.36.82.44:4875 , piece_id=665TS4C7IAPAC3M7V3H54JTOZ6AQV2MTB43VL5X5VELTAQLFOEOA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.106982176 (49h56m22.066079413s) [noise=true , address=104.36.82.58:4282 , piece_id=IAABEON2O7JRYNX6YKEJBIYPCQID47MDUT2FVG5AU73IYMW2ONIA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107056447 (49h56m22.066153694s) [noise=true , address=104.36.82.17:4329 , piece_id=5ATNY2BF4WTMAJDSFHI5ATXSW7ILMXAZVGLHMAE2GK65IWECCPFA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107300789 (49h56m22.066398044s) [noise=true , address=104.36.82.62:4431 , piece_id=CRW7TYSVKA3I5G2TVBWKM46UJ5EKKNOIPGUM242IBUS6EHRI3WSA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107408821 (49h56m22.066506067s) [noise=true , address=64.49.13.169:4707 , piece_id=NZRANY6NWELSKVGK3VMBACMM3XODE2Z2TTQOFHOQTB3JPDVJKZSA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107615402 (49h56m22.066712638s) [noise=true , address=104.36.82.46:4510 , piece_id=YWC4I6DCCKZXJZLIRWLWKVG3M247JQFWA4H57AG6RL4YRLHSWVGQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107764975 (49h56m22.06686223s) [noise=true , address=104.36.82.20:4457 , piece_id=TKINQ5KGXBVJSGM62HYK6AZWQY6W3PACYLR3DE46JGB3Q6TCPLJQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.107924629 (49h56m22.067021875s) [noise=true , address=104.36.82.43:4841 , piece_id=FAKFYFL6QX25PHAA7R3S32TQERHBS6EZ4F4ZBAGOVOR32BCXFFDA, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.108195766 (49h56m22.067293015s) [noise=true , address=104.36.82.8:4982 , piece_id=WVIOWXQKT65ITFYIJB6XHRYL2ZCZP2JXCYTK5JYSFEWAVOYIWIVQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.110246901 (49h56m22.06934415s) [noise=true , address=104.36.82.36:4644 , piece_id=CB3QLV4INCRQESJNF5JFY2UU76GJHVZG6VM6EXAW6CERU5SOEADQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.110891096 (49h56m22.069988348s) [noise=true , address=79.127.201.215:4354 , piece_id=GX2OZJFKRFBQ5HPRAGYBBLPOU7MASVXPPLF643BKKJ4H7VLQBSGQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.111280002 (49h56m22.070377247s) [noise=true , address=104.36.82.39:4733 , piece_id=K5YSA32PQQ327J2JG6YW4HEEPAWXJB656LTJYO5HBBC7KKO2FLUQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.112159417 (49h56m22.071256673s) [noise=true , address=79.127.219.48:4076 , piece_id=DDQEQAIOHUSE5LGPBQRL64DZMB6WL5BAOUOSBQSDW63UNVDU3P2Q, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.113279988 (49h56m22.072377244s) [noise=true , address=45.91.116.4:4962 , piece_id=OE4PVRIIUC6AJW2UMZ2HVI6RAY5IBFBYGA7ISM4VNEYULVYI3LOQ, seg_pos={0 0}, upload=52054]: Uploading piece...
Aug 10 19:22:00.685302477 (49h56m22.644399708s) [upload=52054]: Next returned nil segment
Aug 10 19:22:00.685328264 (49h56m22.644425509s) [upload=52054]: Waiting for error group managing segments...
Aug 10 19:22:00.847262091 (49h56m22.806359336s) [noise=true , address=104.36.82.43:4841 , piece_id=FAKFYFL6QX25PHAA7R3S32TQERHBS6EZ4F4ZBAGOVOR32BCXFFDA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.849857330 (49h56m22.808954569s) [noise=true , address=79.127.219.48:4076 , piece_id=DDQEQAIOHUSE5LGPBQRL64DZMB6WL5BAOUOSBQSDW63UNVDU3P2Q, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.855788335 (49h56m22.814885566s) [noise=true , address=104.36.82.20:4457 , piece_id=TKINQ5KGXBVJSGM62HYK6AZWQY6W3PACYLR3DE46JGB3Q6TCPLJQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.859390091 (49h56m22.818487334s) [noise=true , address=104.36.82.18:4393 , piece_id=I2NC7OSY7DQX7OX2C3Z6TTI23RYWYMTAIWAKKALLTMEWM2JGS5HQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.860997011 (49h56m22.820094241s) [noise=true , address=45.91.116.4:4962 , piece_id=OE4PVRIIUC6AJW2UMZ2HVI6RAY5IBFBYGA7ISM4VNEYULVYI3LOQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.871863323 (49h56m22.83096056s) [noise=true , address=104.36.82.37:4661 , piece_id=JLLY2FHKBEILZR2YDARVQAL66E26RLRPNWINUSJHUOC44CDIZVKQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.874233943 (49h56m22.83333118s) [noise=true , address=104.36.82.36:4644 , piece_id=CB3QLV4INCRQESJNF5JFY2UU76GJHVZG6VM6EXAW6CERU5SOEADQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.891689130 (49h56m22.850786367s) [noise=true , address=104.36.82.61:4405 , piece_id=AYNPZ4PEBMSHVN7WNBNDW4BQKYJKLIHC4KGKGV5OIF7TC2H66CDA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:00.959335211 (49h56m22.918432449s) [noise=true , address=104.36.82.44:4875 , piece_id=665TS4C7IAPAC3M7V3H54JTOZ6AQV2MTB43VL5X5VELTAQLFOEOA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.043521563 (49h56m23.002618801s) [noise=true , address=104.36.82.62:4431 , piece_id=CRW7TYSVKA3I5G2TVBWKM46UJ5EKKNOIPGUM242IBUS6EHRI3WSA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.046956969 (49h56m23.006054204s) [noise=true , address=104.36.82.39:4733 , piece_id=K5YSA32PQQ327J2JG6YW4HEEPAWXJB656LTJYO5HBBC7KKO2FLUQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.080041951 (49h56m23.039139183s) [noise=true , address=104.36.82.17:4329 , piece_id=5ATNY2BF4WTMAJDSFHI5ATXSW7ILMXAZVGLHMAE2GK65IWECCPFA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.130487784 (49h56m23.08958502s) [noise=true , address=79.127.201.215:4354 , piece_id=GX2OZJFKRFBQ5HPRAGYBBLPOU7MASVXPPLF643BKKJ4H7VLQBSGQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.184669780 (49h56m23.143767026s) [noise=true , address=104.36.82.8:4982 , piece_id=WVIOWXQKT65ITFYIJB6XHRYL2ZCZP2JXCYTK5JYSFEWAVOYIWIVQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: <nil>
Aug 10 19:22:01.184715687 (49h56m23.143812934s) [seg_pos={0 0}, upload=52054]: Segment reached optimal threshold of 14 pieces.
Aug 10 19:22:01.184926700 (49h56m23.144023946s) [noise=true , address=104.36.82.58:4282 , piece_id=IAABEON2O7JRYNX6YKEJBIYPCQID47MDUT2FVG5AU73IYMW2ONIA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TcjEH1aW5iW3t2LmMMbn6CCjR5W9cyVDhALoTTmoPtMCFNB5G): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185033963 (49h56m23.144131211s) [noise=true , address=64.49.13.169:4707 , piece_id=NZRANY6NWELSKVGK3VMBACMM3XODE2Z2TTQOFHOQTB3JPDVJKZSA, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185291418 (49h56m23.14438867s) [noise=true , address=64.49.13.139:4469 , piece_id=BXX6AULDXZZS2PEJ4U56AT3BN3CXBXMK3EYFFBATVPHLO4CUEA7A, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185343345 (49h56m23.144440591s) [noise=true , address=104.36.82.46:4510 , piece_id=YWC4I6DCCKZXJZLIRWLWKVG3M247JQFWA4H57AG6RL4YRLHSWVGQ, seg_pos={0 0}, upload=52054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF
Aug 10 19:22:01.185406977 (49h56m23.144504223s) [seg_pos={0 0}, upload=52054]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 19:22:01.185576570 (49h56m23.14467382s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 19:22:01.185585381 (49h56m23.144682628s) [upload=52054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 19:22:01.350824858 (49h56m23.309922113s) [upload=52054]: Done uploading segments...
Aug 10 19:22:01.350851807 (49h56m23.309949055s) [upload=52054]: Upload finished. err: <nil>
Duration: 2.75089114s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
837.306434ms
FAIL (2025-08-10 19:56:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 19:42:00.355900813 (50h16m22.314998052s) [upload=52394]: Starting upload Aug 10 19:42:00.355980883 (50h16m22.315078128s) [upload=52394]: Done starting upload Aug 10 19:42:00.356049760 (50h16m22.315146998s) [upload=52394]: Uploading segments... Aug 10 19:42:00.356140191 (50h16m22.315237445s) [upload=52394]: Got next segment. Inline: true Aug 10 19:42:00.356146991 (50h16m22.315244237s) [upload=52394]: Waiting for error group managing segments... Aug 10 19:42:00.356209584 (50h16m22.31530682s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 19:42:00.356216259 (50h16m22.315313503s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 19:42:00.356219899 (50h16m22.315317145s) [upload=52394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 19:42:00.447113569 (50h16m22.406210813s) [upload=52394]: Done uploading segments... Aug 10 19:42:00.447159988 (50h16m22.406257233s) [upload=52394]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.337602ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|