Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X....X......X..............................] duration: 2.627582315s FAIL (2025-08-19 21:19:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.627618586s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X....X......X.............................] duration: 2.64088542s FAIL (2025-08-19 21:19:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.640936925s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X......................................X............] duration: 857.312282ms FAIL (2025-08-19 21:19:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 857.360112ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X....X......X............................] duration: 2.885640065s FAIL (2025-08-19 21:18:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.885671931s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................................X...........] duration: 850.529008ms FAIL (2025-08-19 21:18:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 850.564211ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................................X..........] duration: 1.273103988s FAIL (2025-08-19 21:17:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.273134845s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X....X......X...........................] duration: 2.911354855s FAIL (2025-08-19 21:17:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.911410861s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X......................................X.........] duration: 1.145710229s FAIL (2025-08-19 21:16:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.145738738s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X....X......X..........................] duration: 2.960074105s FAIL (2025-08-19 21:16:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.960125882s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X....X......X.........................] duration: 2.85246312s FAIL (2025-08-19 21:15:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.852502833s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X......................................X........] duration: 850.531604ms FAIL (2025-08-19 21:15:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 850.560051ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X....X......X........................] duration: 3.007105712s FAIL (2025-08-19 21:15:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 3.007159052s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................................X.......] duration: 1.00870902s FAIL (2025-08-19 21:14:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.008741569s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X......................................X......] duration: 865.267097ms FAIL (2025-08-19 21:14:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 865.30206ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.......................X....X......X.......................] duration: 2.675905631s FAIL (2025-08-19 21:14:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.675961597s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X......................................X.....] duration: 1.074918605s FAIL (2025-08-19 21:13:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.07497247s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.......................X....X......X......................] duration: 2.618029784s FAIL (2025-08-19 21:12:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.618079517s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.......................X....X......X.....................] duration: 2.624525279s FAIL (2025-08-19 21:12:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.624558206s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X......................................X....] duration: 964.641143ms FAIL (2025-08-19 21:12:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 964.69851ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................................X...] duration: 935.916786ms FAIL (2025-08-19 21:11:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 935.945939ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.......................X....X......X....................] duration: 3.041601851s FAIL (2025-08-19 21:11:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 3.041636035s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X......................................X..] duration: 1.429463078s FAIL (2025-08-19 21:10:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.429498749s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................................X.] duration: 818.652515ms FAIL (2025-08-19 21:09:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 818.686201ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.......................X....X......X...................] duration: 2.743340829s FAIL (2025-08-19 21:09:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.743374242s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................................X] duration: 363.205884ms FAIL (2025-08-19 21:09:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 21:09:42.203932709 (267h44m4.163029955s) [upload=278699]: Starting upload Aug 19 21:09:42.204001819 (267h44m4.163099065s) [upload=278699]: Done starting upload Aug 19 21:09:42.204107561 (267h44m4.163204797s) [upload=278699]: Uploading segments... Aug 19 21:09:42.204149873 (267h44m4.163247127s) [upload=278699]: Got next segment. Inline: true Aug 19 21:09:42.204155932 (267h44m4.163253177s) [upload=278699]: Waiting for error group managing segments... Aug 19 21:09:42.204214757 (267h44m4.163312002s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 21:09:42.204220390 (267h44m4.163317635s) [upload=278699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 21:09:42.204225981 (267h44m4.163323227s) [upload=278699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 21:09:42.295922909 (267h44m4.255020155s) [upload=278699]: Done uploading segments... Aug 19 21:09:42.295940690 (267h44m4.255037935s) [upload=278699]: Upload finished. err: metaclient: Too Many Requests Duration:* 363.231372ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 914.583426ms FAIL (2025-08-19 21:09:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 914.613254ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.......................X....X......X..................] duration: 2.687451292s FAIL (2025-08-19 21:09:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.68748311s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.102729419s FAIL (2025-08-19 21:08:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.102780941s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.......................X....X......X.................] duration: 2.594774447s FAIL (2025-08-19 21:08:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.594810772s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X......X.......................X....X......X................] duration: 2.484609255s FAIL (2025-08-19 21:07:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.484631176s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.006405485s FAIL (2025-08-19 21:07:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.00644135s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X......X.......................X....X......X...............] duration: 2.903186482s FAIL (2025-08-19 21:06:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.903222484s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.012446594s FAIL (2025-08-19 21:06:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.012471198s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X......X.......................X....X......X..............] duration: 2.810791424s FAIL (2025-08-19 21:05:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.810822555s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X......X.......................X....X......X.............] duration: 2.900719096s FAIL (2025-08-19 21:05:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.90077195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.446582462s FAIL (2025-08-19 21:04:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.446609888s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X......X.......................X....X......X............] duration: 2.826021376s FAIL (2025-08-19 21:03:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.826055893s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.643268671s FAIL (2025-08-19 21:03:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.643299565s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X......X.......................X....X......X...........] duration: 2.800232422s FAIL (2025-08-19 21:03:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.800262361s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X......X.......................X....X......X..........] duration: 3.423000891s FAIL (2025-08-19 21:03:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 3.423033872s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.992404199s FAIL (2025-08-19 21:02:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.99243897s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X......X.......................X....X......X.........] duration: 3.752407704s FAIL (2025-08-19 21:02:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 3.752442066s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.37356199s FAIL (2025-08-19 21:02:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.373593309s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.218150889s FAIL (2025-08-19 21:01:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.218252064s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.244688428s FAIL (2025-08-19 21:01:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.244717661s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X......X.......................X....X......X........] duration: 3.350619381s FAIL (2025-08-19 21:01:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 3.350738105s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.000644567s FAIL (2025-08-19 21:00:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 1.000672237s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X......X.......................X....X......X.......] duration: 2.73010866s FAIL (2025-08-19 21:00:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after d7a6909d304d520c70d944c257c0294530323148daeaa69c43a9b3432b74e070 != before 8c3abd1c5ff7226f8b58d5bee79eeec73d882aef0c83befb02ab6bb42f92d686 ======LOGS====== Aug 19 20:53:21.189005400 (267h27m43.148102652s) [upload=278410]: Starting upload Aug 19 20:53:21.189067714 (267h27m43.148164961s) [upload=278410]: Done starting upload Aug 19 20:53:21.189434346 (267h27m43.14853159s) [upload=278410]: Uploading segments... Aug 19 20:53:21.189497461 (267h27m43.148594717s) [upload=278410]: Got next segment. Inline: false Aug 19 20:53:21.189547793 (267h27m43.148645043s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:53:21.189553640 (267h27m43.14865089s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 20:53:21.437787497 (267h27m43.396884732s) [seg_pos={0 0}, upload=278410]: Begin upload segment... Aug 19 20:53:21.437854192 (267h27m43.396951424s) [seg_pos={0 0}, upload=278410]: Done begin upload segment. Aug 19 20:53:21.437887681 (267h27m43.39698494s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.438678673 (267h27m43.397775932s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439112449 (267h27m43.398209709s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439519109 (267h27m43.398616366s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.439922823 (267h27m43.399020078s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440288144 (267h27m43.399385393s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440599853 (267h27m43.3996971s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.440935289 (267h27m43.400032525s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441244698 (267h27m43.400341948s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441550519 (267h27m43.400647821s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.441970706 (267h27m43.401067967s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442407416 (267h27m43.40150467s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.442709510 (267h27m43.401806761s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443030496 (267h27m43.402127747s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443354680 (267h27m43.402451934s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.443780141 (267h27m43.402877397s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444245051 (267h27m43.403342309s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:21.444628626 (267h27m43.403725878s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Uploading piece... Aug 19 20:53:22.042433286 (267h27m44.001530523s) [upload=278410]: Next returned nil segment Aug 19 20:53:22.042457085 (267h27m44.001554321s) [upload=278410]: Waiting for error group managing segments... Aug 19 20:53:22.232634156 (267h27m44.191731388s) [noise=true , address=104.36.82.7:4932 , piece_id=JA7ZCFEBKQC6WR44ALUSHEL6UKF4FSGUBMTXV6HG7MTNHLUWUA2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.233805110 (267h27m44.192902348s) [noise=true , address=104.36.82.23:4454 , piece_id=QCEQT4SLAEKVONBCJPSHNKM2EV4HVZKUVKBATZYXVDQTWXF3SBTA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.241305879 (267h27m44.200403117s) [noise=true , address=104.36.82.15:4280 , piece_id=3HEDHAE6Z7BWL4NWEO3U4FY2NSLH6DAKMYNP36TPX25L3FZJ4S2A, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.256916281 (267h27m44.216013536s) [noise=true , address=104.36.82.60:4372 , piece_id=BLVMJ3YQMQGDNGCUIM5KOP7UU5GVEV654CGZUKBLLRFOKSJXQKJQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.264982839 (267h27m44.224080071s) [noise=true , address=104.36.82.16:4321 , piece_id=QNQC72MQG54OPVEWRVCSV42HYNA34R5WCDXGWMYWW7NWDUJRG5JQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.268650996 (267h27m44.227748244s) [noise=true , address=104.36.82.35:4589 , piece_id=HTKIZE6L5R42V7I2HGM7GPQLTFFSBLGJ66UONWSJLCNP3UYB4M2Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.269355891 (267h27m44.228453124s) [noise=true , address=104.36.82.45:4934 , piece_id=Q4UKLZXZBX3OQH4DWMGGKKCTWKM6JUVMVVISZBYXUD7XBX27JCKQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.277710540 (267h27m44.236807789s) [noise=true , address=104.36.82.18:4389 , piece_id=2KCMR6RAVGPQMNH7ATUTO7W5X4QEQLOJ46YBWT2264AHFR65W3WQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.352808629 (267h27m44.31190588s) [noise=true , address=45.91.116.7:4020 , piece_id=PH3TBNF6Q5CRLIQVFDPNKPJ37DS4O46Q3BBLCKQAX2DYU2UT75KQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.432467558 (267h27m44.391564789s) [noise=true , address=77.90.31.16:4765 , piece_id=FLDNS7WCCUVLYW37XUQKBTVHV4Y5DUNDKPGLWHVWKGY4RFKJNS4Q, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.436300609 (267h27m44.395397845s) [noise=true , address=45.91.116.10:4104 , piece_id=GNAMWJZOZCHD4PF6SNSVHOWRLBXDRJOD5GOPO4ZVVABRHNFYKTSA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.458881783 (267h27m44.417979019s) [noise=true , address=77.90.31.19:4870 , piece_id=T6IY3WU7PBOO24QB3ZY7A37VQBIHYG3IYV7IXN72YKU3IBAHR3LQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.474490358 (267h27m44.43358759s) [noise=true , address=79.127.201.214:4320 , piece_id=TEVPCJGHGAF6UCVCPKSDK37U5Z3KFH7HBJ5CTSOUIEX76PSTYDFQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479363012 (267h27m44.438460248s) [noise=true , address=77.90.31.13:4633 , piece_id=ULMNLCR6BN2TRQVEZ75MLESEA2CMLV2BAMZQHSGLEKFR3QRMXVMA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: <nil> Aug 19 20:53:22.479394596 (267h27m44.438491841s) [seg_pos={0 0}, upload=278410]: Segment reached optimal threshold of 14 pieces. Aug 19 20:53:22.479675449 (267h27m44.43877268s) [noise=true , address=104.36.82.5:4871 , piece_id=3ZXXV4QG32TY4XYFYN55K4RCDVS4HFN3ZDBO7ZLCUTRXBLRHQ5TQ, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: expected piece hash; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:36906->104.36.82.5:4871: use of closed network connection; EOF Aug 19 20:53:22.479784839 (267h27m44.43888207s) [noise=true , address=77.90.31.11:4585 , piece_id=3VGK5DHTWCP2BTOY2KSFN3QKYAVA5PUOJPGJVPECOYWSCQSDZFKA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF Aug 19 20:53:22.479907534 (267h27m44.439004779s) [noise=true , address=66.23.193.175:4555 , piece_id=UVJJKIKEKSR3FEKD3WDHMBCBKP4JBFRFBJYKE2GYPKEAINW5N5XA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38510->66.23.193.175:4555: use of closed network connection Aug 19 20:53:22.479965383 (267h27m44.43906262s) [noise=true , address=77.90.31.11:4564 , piece_id=Q4TEEKATE7ND2IOBADH4PLXOVSQGYPQOFG7OZKPNOFWHAK63NTPA, seg_pos={0 0}, upload=278410]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47158->77.90.31.11:4564: use of closed network connection Aug 19 20:53:22.480011894 (267h27m44.439109126s) [seg_pos={0 0}, upload=278410]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 20:53:22.480133134 (267h27m44.439230379s) [upload=278410]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 20:53:22.480139145 (267h27m44.439236392s) [upload=278410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:53:22.967695671 (267h27m44.926792923s) [upload=278410]: Done uploading segments... Aug 19 20:53:22.967719691 (267h27m44.926816936s) [upload=278410]: Upload finished. err: <nil> Duration: 2.730165617s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 942.508488ms FAIL (2025-08-19 20:59:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 942.542668ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X................................X..........................] duration: 847.964195ms FAIL (2025-08-19 20:59:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 20:41:22.159843247 (267h15m44.118940513s) [upload=278202]: Starting upload Aug 19 20:41:22.159901344 (267h15m44.1189986s) [upload=278202]: Done starting upload Aug 19 20:41:22.159984854 (267h15m44.119082086s) [upload=278202]: Uploading segments... Aug 19 20:41:22.160040612 (267h15m44.119137868s) [upload=278202]: Got next segment. Inline: true Aug 19 20:41:22.160046244 (267h15m44.119143513s) [upload=278202]: Waiting for error group managing segments... Aug 19 20:41:22.160100786 (267h15m44.119198057s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 20:41:22.160108663 (267h15m44.119205919s) [upload=278202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 20:41:22.160113517 (267h15m44.119210774s) [upload=278202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 20:41:22.355944615 (267h15m44.315041849s) [upload=278202]: Done uploading segments... Aug 19 20:41:22.355964907 (267h15m44.315062143s) [upload=278202]: Upload finished. err: <nil> Duration:* 847.997517ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)