Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.627587204s
FAIL (2025-07-07 05:20:04 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.627622326s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.287419242s
FAIL (2025-07-07 05:19:45 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.287452967s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
880.267387ms
FAIL (2025-07-07 05:19:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 880.300998ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.276922447s
FAIL (2025-07-07 05:19:22 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.277011826s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.532154899s
FAIL (2025-07-07 05:19:08 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.532194991s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
850.618099ms
FAIL (2025-07-07 05:19:05 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 850.650469ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.095047202s
FAIL (2025-07-07 05:18:54 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.095081362s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.156429179s
FAIL (2025-07-07 05:18:38 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.156461735s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.283356467s
FAIL (2025-07-07 05:18:35 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.283396592s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.398619636s
FAIL (2025-07-07 05:18:35 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.398652201s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
874.328566ms
FAIL (2025-07-07 05:18:14 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 874.405536ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
860.330632ms
FAIL (2025-07-07 05:17:57 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 860.384785ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.315557848s
FAIL (2025-07-07 05:17:55 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.315590466s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.219880019s
FAIL (2025-07-07 05:17:47 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.21990844s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.282483523s
FAIL (2025-07-07 05:17:36 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.282515923s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
856.38847ms
FAIL (2025-07-07 05:17:32 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 856.528941ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.368341622s
FAIL (2025-07-07 05:17:12 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.36837211s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.45935883s
FAIL (2025-07-07 05:16:54 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.459396836s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.320048455s
FAIL (2025-07-07 05:16:42 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.320083493s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
863.392545ms
FAIL (2025-07-07 05:16:40 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 863.418062ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.282648584s
FAIL (2025-07-07 05:16:31 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.282675226s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.497072026s
FAIL (2025-07-07 05:16:09 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.497106595s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.516751039s
FAIL (2025-07-07 05:16:04 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.516855976s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.173563434s
FAIL (2025-07-07 05:16:00 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.17365837s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
876.520418ms
FAIL (2025-07-07 05:15:40 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 876.553321ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.513521046s
FAIL (2025-07-07 05:15:32 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.513551362s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.301312261s
FAIL (2025-07-07 05:15:30 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.301345533s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.475651371s
FAIL (2025-07-07 05:15:23 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.475687s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.347464431s
FAIL (2025-07-07 05:15:05 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.347564076s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
872.544241ms
FAIL (2025-07-07 05:14:55 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 872.57946ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
921.06703ms
FAIL (2025-07-07 05:14:24 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 921.168293ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.493254684s
FAIL (2025-07-07 05:14:22 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.493307538s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.40422909s
FAIL (2025-07-07 05:14:19 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.404262153s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
853.052012ms
FAIL (2025-07-07 05:14:07 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 853.116247ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.351619278s
FAIL (2025-07-07 05:13:58 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.351679091s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.302485351s
FAIL (2025-07-07 05:13:49 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.302526433s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
876.328188ms
FAIL (2025-07-07 05:13:46 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 876.420652ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.264009429s
FAIL (2025-07-07 05:13:44 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.264042416s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
859.54383ms
FAIL (2025-07-07 05:13:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 859.573101ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.313878512s
FAIL (2025-07-07 05:13:27 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.313905773s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
907.540115ms
FAIL (2025-07-07 05:13:09 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 907.571428ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.222677446s
FAIL (2025-07-07 05:13:06 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.222721023s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.314686554s
FAIL (2025-07-07 05:13:05 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.314757725s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.28251497s
FAIL (2025-07-07 05:13:05 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.282548192s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.336810341s
FAIL (2025-07-07 05:12:35 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.336842051s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.507003556s
FAIL (2025-07-07 05:12:28 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.507033594s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.081606553s
FAIL (2025-07-07 05:12:13 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.081627131s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.478807098s
FAIL (2025-07-07 05:12:03 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.478835388s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001029674s
FAIL (2025-07-07 05:12:01 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 1m0.001102532s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.256070843s
FAIL (2025-07-07 05:12:00 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.256106899s
core
uplink
us1
|