Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X........................X......................] duration:
2.461343121s
FAIL (2025-08-13 07:06:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.461397005s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X......X..................X.................] duration:
846.926997ms
FAIL (2025-08-13 07:05:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 846.954397ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................X.....................] duration:
2.448559925s
FAIL (2025-08-13 07:05:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.448592629s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................X....................] duration:
2.403089751s
FAIL (2025-08-13 07:04:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.40312781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X......X..................X................] duration:
1.006247707s
FAIL (2025-08-13 07:04:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 1.006366677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.................X......X..................X...............] duration:
835.62639ms
FAIL (2025-08-13 07:04:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 835.675909ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................X...................] duration:
2.459418033s
FAIL (2025-08-13 07:04:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.459452344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.................X......X..................X..............] duration:
1.218162827s
FAIL (2025-08-13 07:03:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 1.218193066s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X........................X..................] duration:
2.603545018s
FAIL (2025-08-13 07:03:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.60357712s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.................X......X..................X.............] duration:
823.033671ms
FAIL (2025-08-13 07:02:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 823.062278ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.................X......X..................X............] duration:
1.081757921s
FAIL (2025-08-13 07:02:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 1.081852379s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................X.................] duration:
2.383956578s
FAIL (2025-08-13 07:02:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.38398966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................X................] duration:
2.457704227s
FAIL (2025-08-13 07:01:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.457730567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.................X......X..................X...........] duration:
856.51152ms
FAIL (2025-08-13 07:01:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 856.551312ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.................X......X..................X..........] duration:
1.033232499s
FAIL (2025-08-13 07:00:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 1.033272978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X........................X...............] duration:
2.530810137s
FAIL (2025-08-13 07:00:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.530833733s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.................X......X..................X.........] duration:
1.027610837s
FAIL (2025-08-13 06:59:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 1.0276355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X........................X..............] duration:
2.263379445s
FAIL (2025-08-13 06:59:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.263468581s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.................X......X..................X........] duration:
850.592967ms
FAIL (2025-08-13 06:58:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 850.647926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X........................X.............] duration:
2.645241154s
FAIL (2025-08-13 06:58:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.645283349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.................X......X..................X.......] duration:
838.798401ms
FAIL (2025-08-13 06:57:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 838.827395ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X........................X............] duration:
2.428638716s
FAIL (2025-08-13 06:57:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.428676422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X........................X...........] duration:
2.365856873s
FAIL (2025-08-13 06:57:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.365885742s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.................X......X..................X......] duration:
821.975916ms
FAIL (2025-08-13 06:57:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 822.002416ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X........................X..........] duration:
2.279660575s
FAIL (2025-08-13 06:57:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.279690374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.................X......X..................X.....] duration:
844.92971ms
FAIL (2025-08-13 06:56:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 844.969444ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X........................X.........] duration:
2.391582845s
FAIL (2025-08-13 06:56:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.391622787s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.................X......X..................X....] duration:
853.007358ms
FAIL (2025-08-13 06:56:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 853.063533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X........................X........] duration:
3.868668006s
FAIL (2025-08-13 06:55:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 3.868710215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.................X......X..................X...] duration:
1.103938072s
FAIL (2025-08-13 06:55:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 1.103980644s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X........................X.......] duration:
2.516668431s
FAIL (2025-08-13 06:54:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.51670441s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X........................X......] duration:
2.831342941s
FAIL (2025-08-13 06:53:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.831403848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.................X......X..................X..] duration:
1.141862781s
FAIL (2025-08-13 06:53:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 1.141899376s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.................X......X..................X.] duration:
852.939989ms
FAIL (2025-08-13 06:52:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 852.974273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X........................X.....] duration:
2.456017228s
FAIL (2025-08-13 06:52:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.456055147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.................X......X..................X] duration:
705.507585ms
FAIL (2025-08-13 06:52:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 06:52:09.945542984 (109h26m31.904640243s) [upload=114010]: Starting upload
Aug 13 06:52:09.945621668 (109h26m31.90471892s) [upload=114010]: Done starting upload
Aug 13 06:52:09.945726400 (109h26m31.90482365s) [upload=114010]: Uploading segments...
Aug 13 06:52:09.945876126 (109h26m31.90497338s) [upload=114010]: Got next segment. Inline: true
Aug 13 06:52:09.945887231 (109h26m31.904984487s) [upload=114010]: Waiting for error group managing segments...
Aug 13 06:52:09.945994409 (109h26m31.905091657s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:52:09.946003106 (109h26m31.905100356s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 06:52:09.946023960 (109h26m31.905121208s) [upload=114010]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:52:10.094843013 (109h26m32.05394027s) [upload=114010]: Done uploading segments...
Aug 13 06:52:10.094872992 (109h26m32.053970248s) [upload=114010]: Upload finished. err: <nil>
Duration: 705.544861ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X........................X....] duration:
2.329445894s
FAIL (2025-08-13 06:52:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.329482074s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.................X......X..................] duration:
848.285834ms
FAIL (2025-08-13 06:51:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.315588ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X........................X...] duration:
2.431789924s
FAIL (2025-08-13 06:51:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.431820519s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.................X......X.................] duration:
825.988296ms
FAIL (2025-08-13 06:50:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.020093ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X........................X..] duration:
2.375708822s
FAIL (2025-08-13 06:50:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.375742656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.................X......X................] duration:
852.699657ms
FAIL (2025-08-13 06:50:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.728814ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X........................X.] duration:
2.45039128s
FAIL (2025-08-13 06:50:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 2.450430203s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.................X......X...............] duration:
831.318449ms
FAIL (2025-08-13 06:49:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.34413ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.................X......X..............] duration:
835.086111ms
FAIL (2025-08-13 06:49:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.13262ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X........................X] duration:
1.619775077s
FAIL (2025-08-13 06:48:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 06:48:53.992403626 (109h23m15.951500862s) [upload=113950]: Starting upload
Aug 13 06:48:53.992462756 (109h23m15.951560008s) [upload=113950]: Done starting upload
Aug 13 06:48:53.992701872 (109h23m15.951799107s) [upload=113950]: Uploading segments...
Aug 13 06:48:53.992993044 (109h23m15.952090313s) [upload=113950]: Got next segment. Inline: false
Aug 13 06:48:53.993039820 (109h23m15.952137056s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 06:48:53.993045824 (109h23m15.95214306s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 06:48:54.191690324 (109h23m16.15078758s) [seg_pos={0 0}, upload=113950]: Begin upload segment...
Aug 13 06:48:54.191763131 (109h23m16.150860375s) [seg_pos={0 0}, upload=113950]: Done begin upload segment.
Aug 13 06:48:54.191793653 (109h23m16.150890899s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.191826323 (109h23m16.150923579s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192171353 (109h23m16.151268601s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192452529 (109h23m16.151549775s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192510955 (109h23m16.15160821s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.192837492 (109h23m16.151934743s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193169005 (109h23m16.152266261s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193237433 (109h23m16.152334706s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193470364 (109h23m16.152567612s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.193792542 (109h23m16.152889798s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.194103437 (109h23m16.153200683s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196147155 (109h23m16.155244411s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.196793113 (109h23m16.155890369s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198148604 (109h23m16.157245859s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.198719372 (109h23m16.157816629s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.199932757 (109h23m16.159030017s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.200488224 (109h23m16.15958548s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.201088576 (109h23m16.160185831s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Uploading piece...
Aug 13 06:48:54.766990634 (109h23m16.726087867s) [upload=113950]: Next returned nil segment
Aug 13 06:48:54.767009340 (109h23m16.726106591s) [upload=113950]: Waiting for error group managing segments...
Aug 13 06:48:54.904489352 (109h23m16.863586598s) [noise=true , address=77.90.31.19:4857 , piece_id=EPAKVTV5IHQHZU3JYCCDCL25I7LLSP2YQGBI3WEA7VK4BHSFAOWA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.905705948 (109h23m16.864803181s) [noise=true , address=77.90.31.12:4622 , piece_id=QDKDY7OV7ESUVZWPVXHJHJXLBU533OTLCRW64ISKRS452I3JJQ2A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.907725522 (109h23m16.866822753s) [noise=true , address=77.90.31.18:4839 , piece_id=UYHX6BHTLC6MYFOH7UCMHB2SUH5PUL7NZ6UNOPYAUNWS7P6ZXPQQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.910687612 (109h23m16.869784862s) [noise=true , address=77.90.31.11:4580 , piece_id=JSG7GPTZH5BG4KX5BJQMCATT4KNDMOJUSOY7VG2Y7YI7SQFSZ5OQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.932126065 (109h23m16.891223297s) [noise=true , address=104.36.82.36:4641 , piece_id=2OQYDP3PTLWSKZCKVKWTKQPMTJLQEKGHF2TVDTN2KXGS6GAHDMHA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.933796857 (109h23m16.892894095s) [noise=true , address=104.36.82.34:4557 , piece_id=C5VOXXTLONT77BINQDH7NG76EARYU5M6IZBVFNJGB653VJP6AETA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.943511394 (109h23m16.902608628s) [noise=true , address=104.36.82.44:4899 , piece_id=E4NLLIFJV2GPNFTOF5M2VUPOECLXAYXPF52DQ5K4J5UHOZ7XQM5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.947451328 (109h23m16.906548562s) [noise=true , address=104.36.82.60:4350 , piece_id=HDHK3DRIRRV7FEIINHUNXE756IWBXMC2GTM2RXAF45OOWDJMZZPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.948673536 (109h23m16.907770774s) [noise=true , address=104.36.82.62:4418 , piece_id=HKZDXPXLF4ES3HLQOQIUP4VBDAEKDSGP3YXFSJFP7PCDHZMGWGLQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.953776047 (109h23m16.912873283s) [noise=true , address=104.36.82.59:4326 , piece_id=BZQDHBS4WSLU5VS24TJBDL3S3EPW62JYW2JQAEJ5PX4H5S2EUDPQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.965410613 (109h23m16.924507848s) [noise=true , address=104.36.82.39:4748 , piece_id=6S4SJCGDL3PGVBHDCSHCUSCLWZT7VPVJMX7MAEXTJNOQF53NY56A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.970104132 (109h23m16.929201369s) [noise=true , address=104.36.82.18:4369 , piece_id=RB7UMZBXBZD2JZ6A5HY3PBV5MMCL5AUOZUESRGBZX7RYEY7EJB2Q, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.974706159 (109h23m16.933803392s) [noise=true , address=104.36.82.23:4469 , piece_id=SFK7XWRMM5LCINOSNNCVGYBPE34224VQRJ2GBDUV2BBTW776C4TA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985359860 (109h23m16.944457095s) [noise=true , address=77.90.31.10:4534 , piece_id=PWCW627AVGANL25HGFS7SXY3IQJPH4HJ6CD74LDB5XWFBMZDOWNA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: <nil>
Aug 13 06:48:54.985392086 (109h23m16.944489334s) [seg_pos={0 0}, upload=113950]: Segment reached optimal threshold of 14 pieces.
Aug 13 06:48:54.985591956 (109h23m16.944689209s) [noise=true , address=79.127.201.215:4360 , piece_id=G5WCTKHY6K63MBSHOSTPN5HUYUU4HDKO5OX7IP2W4XAGZWHM7ADQ, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985697896 (109h23m16.944795129s) [noise=true , address=64.49.13.26:4956 , piece_id=HDJ7EPIZ7WK3EYBJQQQRZXW6N5F7UQGS47M3WQV724UM7RUXKX5A, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TYHhjpfyBKkenSwviyQCUZpSBbnaFCGBFRkM4fyKLDuxKx4Ju): protocol: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53154->64.49.13.26:4956: use of closed network connection
Aug 13 06:48:54.985738055 (109h23m16.944835288s) [noise=true , address=104.36.82.35:4582 , piece_id=URV4SSJHSO7SFYH4GFG7YAEKA3GWPXMQDC7IYJPEZG76JMBPDGBA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa): protocol: expected piece hash; context canceled; EOF
Aug 13 06:48:54.985830685 (109h23m16.944927936s) [noise=true , address=66.23.193.175:4564 , piece_id=JJKPL5NSUNRQFKZCRI5OBAIC6VXFFDMG3FL6OEORRT4PFPQN2TGA, seg_pos={0 0}, upload=113950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54366->66.23.193.175:4564: use of closed network connection
Aug 13 06:48:54.985871682 (109h23m16.94496893s) [seg_pos={0 0}, upload=113950]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 06:48:54.985988038 (109h23m16.945085287s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 06:48:54.985994846 (109h23m16.9450921s) [upload=113950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 06:48:55.129438887 (109h23m17.088536132s) [upload=113950]: Done uploading segments...
Aug 13 06:48:55.129463849 (109h23m17.088561094s) [upload=113950]: Upload finished. err: <nil>
Duration: 1.619808604s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.................X......X.............] duration:
820.58579ms
FAIL (2025-08-13 06:48:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.619293ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.................X......X............] duration:
828.129752ms
FAIL (2025-08-13 06:48:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.16964ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.587855144s
FAIL (2025-08-13 06:47:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:31:05.785986169 (109h5m27.745083405s) [upload=113640]: Starting upload Aug 13 06:31:05.786056603 (109h5m27.745153851s) [upload=113640]: Done starting upload Aug 13 06:31:05.786322107 (109h5m27.745419353s) [upload=113640]: Uploading segments... Aug 13 06:31:05.786532473 (109h5m27.745629718s) [upload=113640]: Got next segment. Inline: false Aug 13 06:31:05.786586450 (109h5m27.745683686s) [upload=113640]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:31:05.786592029 (109h5m27.745689264s) [upload=113640]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 06:31:05.906678893 (109h5m27.865776169s) [upload=113640]: Next segment err: metaclient: Too Many Requests Aug 13 06:31:05.906726937 (109h5m27.865824212s) [upload=113640]: Done uploading segments... Aug 13 06:31:05.906747083 (109h5m27.865844343s) [upload=113640]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.587883988s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.................X......X...........] duration:
861.287296ms
FAIL (2025-08-13 06:47:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 06:39:20.104459827 (109h13m42.063557064s) [upload=113782]: Starting upload Aug 13 06:39:20.104520198 (109h13m42.063617435s) [upload=113782]: Done starting upload Aug 13 06:39:20.104594396 (109h13m42.063691642s) [upload=113782]: Uploading segments... Aug 13 06:39:20.104969040 (109h13m42.064066295s) [upload=113782]: Got next segment. Inline: true Aug 13 06:39:20.104985656 (109h13m42.064082914s) [upload=113782]: Waiting for error group managing segments... Aug 13 06:39:20.105095440 (109h13m42.064192693s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 06:39:20.105102594 (109h13m42.064199841s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 06:39:20.105106546 (109h13m42.064203798s) [upload=113782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 06:39:20.198383732 (109h13m42.157480985s) [upload=113782]: Done uploading segments... Aug 13 06:39:20.198409752 (109h13m42.157506993s) [upload=113782]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.319372ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|