Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.45279193s
FAIL (2025-07-07 05:30:27 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.452821186s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.668986279s
FAIL (2025-07-07 05:30:17 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.669106801s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.057171723s
FAIL (2025-07-07 05:29:53 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.057210659s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.28286795s
FAIL (2025-07-07 05:29:44 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.28289531s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.230355418s
FAIL (2025-07-07 05:29:23 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.230383473s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.415428963s
FAIL (2025-07-07 05:29:19 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.41546116s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.331909667s
FAIL (2025-07-07 05:28:49 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.331944558s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.091685609s
FAIL (2025-07-07 05:28:43 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.091714391s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.340240126s
FAIL (2025-07-07 05:28:39 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.340269554s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.254212311s
FAIL (2025-07-07 05:28:25 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.254240042s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
880.338621ms
FAIL (2025-07-07 05:28:24 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 880.364744ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.28337642s
FAIL (2025-07-07 05:27:53 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.28341229s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.504124205s
FAIL (2025-07-07 05:27:52 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.504160276s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.410873898s
FAIL (2025-07-07 05:27:28 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.410908217s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
856.275904ms
FAIL (2025-07-07 05:27:16 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 856.306164ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.41372751s
FAIL (2025-07-07 05:27:10 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.413826657s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.257855974s
FAIL (2025-07-07 05:26:55 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.257892798s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.455123852s
FAIL (2025-07-07 05:26:27 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.455156329s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.385385168s
FAIL (2025-07-07 05:26:24 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.385424687s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.374708088s
FAIL (2025-07-07 05:26:13 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.374736659s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
860.039149ms
FAIL (2025-07-07 05:26:08 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 860.13658ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.366426987s
FAIL (2025-07-07 05:25:24 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.366486885s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
857.988906ms
FAIL (2025-07-07 05:25:18 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 858.018989ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.290916572s
FAIL (2025-07-07 05:25:15 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.290961979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.297330581s
FAIL (2025-07-07 05:25:10 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.297366505s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.264648277s
FAIL (2025-07-07 05:24:41 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.264682037s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.36145002s
FAIL (2025-07-07 05:24:23 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.36148368s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.287670154s
FAIL (2025-07-07 05:24:21 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.287708512s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
894.632216ms
FAIL (2025-07-07 05:24:15 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 894.668284ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.344375226s
FAIL (2025-07-07 05:24:12 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.344408578s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.461843717s
FAIL (2025-07-07 05:24:03 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.461882195s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
879.150197ms
FAIL (2025-07-07 05:23:54 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 879.178893ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.046901519s
FAIL (2025-07-07 05:23:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.046934266s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.358424971s
FAIL (2025-07-07 05:23:24 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.358479922s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.417800773s
FAIL (2025-07-07 05:23:09 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.417834463s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.875730023s
FAIL (2025-07-07 05:23:03 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.875782483s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.568958418s
FAIL (2025-07-07 05:22:38 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.56898959s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.118742799s
FAIL (2025-07-07 05:22:33 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.118774559s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.123459402s
FAIL (2025-07-07 05:22:12 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.123491356s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.567440031s
FAIL (2025-07-07 05:22:02 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.567473632s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.343579547s
FAIL (2025-07-07 05:22:00 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.343613648s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.535555086s
FAIL (2025-07-07 05:21:53 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.53559285s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.312980438s
FAIL (2025-07-07 05:21:27 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.31301485s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.251862733s
FAIL (2025-07-07 05:21:26 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.25189506s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
900.234393ms
FAIL (2025-07-07 05:21:02 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 900.274675ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.328247576s
FAIL (2025-07-07 05:20:55 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Jul 7 05:09:58.308208571 (331h58m58.191622205s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.308734247 (331h58m58.192147875s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.309210086 (331h58m58.192623717s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310026291 (331h58m58.193439922s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310399026 (331h58m58.193812658s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.310730643 (331h58m58.19414428s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311016357 (331h58m58.194429986s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311282949 (331h58m58.194696562s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311529058 (331h58m58.194942687s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.311764848 (331h58m58.195178477s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312104640 (331h58m58.195518276s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.312671311 (331h58m58.196084942s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.313481494 (331h58m58.196895126s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314030452 (331h58m58.197444091s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314479100 (331h58m58.197892732s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.314681531 (331h58m58.198095164s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Uploading piece...
Jul 7 05:09:58.868182824 (331h58m58.751596436s) [upload=265469]: Next returned nil segment
Jul 7 05:09:58.868199665 (331h58m58.751613277s) [upload=265469]: Waiting for error group managing segments...
Jul 7 05:09:59.012132628 (331h58m58.89554625s) [noise=true , address=77.90.31.21:4895 , piece_id=ER73FAMWWCULLO2AY2SSRA4K7B7IPOJQX6S5TL2VHLSIK3THOS4A, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.012567784 (331h58m58.8959814s) [noise=true , address=77.90.31.19:4861 , piece_id=CDA3ND4VIAD635RXJE7FBV45OS2PMIRX6E6AYEKZXEXW36AI5QVQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.015885049 (331h58m58.899298668s) [noise=true , address=104.36.82.42:4797 , piece_id=SPX5QGKVKT34IJAQWKVNPPVYFVASOMV7VPPIAAWTJWWTTCQOTAKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.016924154 (331h58m58.900337773s) [noise=true , address=104.36.82.60:4356 , piece_id=QB3ITWGGUK7XGEGONIXXXM2KAZHXR7HPIJMDHS757NXN5IMXU6PA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.017329270 (331h58m58.900742888s) [noise=true , address=77.90.31.14:4665 , piece_id=DQHDIUTJZWK53Q47IEQ2GQ5JS2WLG3TNTVPUSAQUHGNZVJ27GAVA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.018415699 (331h58m58.90182933s) [noise=true , address=104.36.82.59:4306 , piece_id=MALRM2CL23LBQ4C5ICI7Q5LJP5CEUY3E3B23EKG74KBIGVN7AT4Q, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.019049424 (331h58m58.902463042s) [noise=true , address=104.36.82.19:4408 , piece_id=QT32QTQMFIJDV5MC5DMDIDUG3OXDBWMBQ2W2RTF6TMVYIVFLJZTQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020263316 (331h58m58.903676931s) [noise=true , address=104.36.82.37:4654 , piece_id=PUGVB2YQ6SQOAEBPHJE2BNVIRVCWAARU6D4BFDBGQF7R3K3FLIWA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.020463834 (331h58m58.903877453s) [noise=true , address=77.90.31.10:4544 , piece_id=LSXSP3ZDZ7AC4BPIYH5RUP7X5Z7RLSSFYQ6PAX2FDEIFCHMMWVTA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.022875521 (331h58m58.906289141s) [noise=true , address=104.36.82.7:4925 , piece_id=HDXCRT6E33RR5RZI6HIL33FZBQ5MWYXA4DRHJ2FRIBT6CGUV6EXA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028066330 (331h58m58.911479948s) [noise=true , address=77.90.31.16:4763 , piece_id=5QZDW25ATTLDCCOYBVKJ2N7FMECWILSQ3EDMNJRPPK3Q75WYRVJA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028219276 (331h58m58.911632896s) [noise=true , address=104.36.82.16:4317 , piece_id=QAR2AVSKLM7IIHV5VLN5YUHFQW2JCG65IZFJLW2EZGZMUJ3L2LRQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.028565565 (331h58m58.911979184s) [noise=true , address=104.36.82.44:4876 , piece_id=NYFXB3BCBIQGELQMXFDUXVUOX3CMXFSW3ZG532YACUJQDHC773UQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.043986656 (331h58m58.927400276s) [noise=true , address=77.90.31.13:4644 , piece_id=WVEPTDWZALW6UN52QD6JA5CLCUWGSSAOJHOZEPFVAJFTQCJXLYAQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: <nil>
Jul 7 05:09:59.044041656 (331h58m58.927455283s) [seg_pos={0 0}, upload=265469]: Segment reached optimal threshold of 14 pieces.
Jul 7 05:09:59.044245811 (331h58m58.927659428s) [noise=true , address=104.36.82.23:4477 , piece_id=XCTYPXLJ7SMC6G5OJVN2YVOQUTYAHZMODFLAPOSVK4JBIHOCGMZA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044434817 (331h58m58.927848435s) [noise=true , address=104.36.82.9:4014 , piece_id=VRS6DQBNZ3CSQQPIA2XXFB3BE3KWSWXNSWXDMNJEDGY5IIYR4IKA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uK9ULUdABDm5XBP4nh1omWhR5qoQerFsCmL4bQ9dmNespXpTy): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044891355 (331h58m58.928304971s) [noise=true , address=79.127.205.245:4249 , piece_id=JOGKEPTW36OHYZF5PSKFD5X3S3SEJUNKZRVHKI7KCXSRKPVDATFQ, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ofwUBJwLG7eUYo7JE1ufwxRRyQ9HUpTZnshuTz6YF2JMfzVcX): protocol: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48236->79.127.205.245:4249: use of closed network connection
Jul 7 05:09:59.044966747 (331h58m58.928380363s) [noise=true , address=79.127.219.51:4193 , piece_id=ECDT7NDAKQSCWB2DBEFSZQWELWIVHY4UTXAZJ6E56M3ERLI57FHA, seg_pos={0 0}, upload=265469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S8DH9HjrWtHF1rS2ujw2REK89NZozY4JyriSDe19JRvaPAEaC): protocol: expected piece hash; context canceled; EOF
Jul 7 05:09:59.044979707 (331h58m58.928393323s) [seg_pos={0 0}, upload=265469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 7 05:09:59.045070085 (331h58m58.928483702s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:09:59.045075321 (331h58m58.92848895s) [upload=265469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:09:59.202890884 (331h58m59.086304504s) [upload=265469]: Done uploading segments...
Jul 7 05:09:59.202911165 (331h58m59.086324782s) [upload=265469]: Upload finished. err: <nil>
Jul 7 05:11:57.215909891 (332h0m57.099323509s) [upload=265496]: Starting upload
Jul 7 05:11:57.216000506 (332h0m57.099414135s) [upload=265496]: Done starting upload
Jul 7 05:11:57.216124972 (332h0m57.099538589s) [upload=265496]: Uploading segments...
Jul 7 05:11:57.216248064 (332h0m57.099661681s) [upload=265496]: Got next segment. Inline: false
Jul 7 05:11:57.216300775 (332h0m57.099714392s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:11:57.216307152 (332h0m57.099720778s) [upload=265496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:12:01.227865592 (332h1m1.111279226s) [upload=265496]: Next segment err: context deadline exceeded
Jul 7 05:12:01.228053232 (332h1m1.111466862s) [upload=265496]: Done uploading segments...
Jul 7 05:12:01.228112092 (332h1m1.111525719s) [upload=265496]: Upload finished. err: context deadline exceeded
Duration: 2.328277841s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.306063431s
FAIL (2025-07-07 05:20:49 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.30610354s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.286961308s
FAIL (2025-07-07 05:20:34 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
[upload=265404]: Upload finished. err: <nil>
Jul 7 05:05:33.269964874 (331h54m33.1533785s) [upload=265414]: Starting upload
Jul 7 05:05:33.270046842 (331h54m33.153460468s) [upload=265414]: Done starting upload
Jul 7 05:05:33.270233236 (331h54m33.15364685s) [upload=265414]: Uploading segments...
Jul 7 05:05:33.270444267 (331h54m33.153857895s) [upload=265414]: Got next segment. Inline: false
Jul 7 05:05:33.270494407 (331h54m33.153908021s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:05:33.270501547 (331h54m33.153915173s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:05:33.378898646 (331h54m33.262312277s) [seg_pos={0 0}, upload=265414]: Begin upload segment...
Jul 7 05:05:33.378975023 (331h54m33.262388642s) [seg_pos={0 0}, upload=265414]: Done begin upload segment.
Jul 7 05:05:33.379006225 (331h54m33.262419853s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379012279 (331h54m33.262425909s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379474661 (331h54m33.26288828s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379483984 (331h54m33.262897614s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.379897210 (331h54m33.263310838s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380309148 (331h54m33.263722778s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.380773118 (331h54m33.264186746s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381223739 (331h54m33.264637371s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381606064 (331h54m33.265019696s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.381995228 (331h54m33.26540886s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382301838 (331h54m33.265715473s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382562785 (331h54m33.265976412s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.382970034 (331h54m33.266383662s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383146457 (331h54m33.266560083s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383486916 (331h54m33.266900549s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.383791299 (331h54m33.267204928s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Uploading piece...
Jul 7 05:05:33.994439657 (331h54m33.877853276s) [upload=265414]: Next returned nil segment
Jul 7 05:05:33.994458091 (331h54m33.877871717s) [upload=265414]: Waiting for error group managing segments...
Jul 7 05:05:34.126806204 (331h54m34.01021983s) [noise=true , address=104.36.82.2:4729 , piece_id=CG7VFKAQUSSLRO2WGZEQFKZ6BFXOLZWIPGDQ4P3EYWXGCV3FHCQQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128424248 (331h54m34.011837867s) [noise=true , address=45.91.116.6:4974 , piece_id=6MSFH3XEJXX2LHZHHY52EUV2LHDBAQAPX73NBW4AZGIQQSZDWXCQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.128593904 (331h54m34.01200753s) [noise=true , address=77.90.31.18:4805 , piece_id=KNYXMXUWHMY5ZHZDJIAYZTEWGZWSLZ6CTCQNTVDDPPDO5BOXTPEQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129502678 (331h54m34.012916298s) [noise=true , address=104.36.82.7:4912 , piece_id=7UZ3HPPIZFJRHOL7AC7HUVKZWJYK4OEEPHE3ZT46V5VWIE4I3TFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.129998155 (331h54m34.013411767s) [noise=true , address=77.90.31.10:4518 , piece_id=QD6A25CHBB62BPH2AP6B5KYQTW7ROBTR64UD74PYQG67X2UJHJMQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.134672993 (331h54m34.018086614s) [noise=true , address=104.36.82.9:4005 , piece_id=4TD4QWPFHOR2CDZD57AWQ2WBJS7WB3TTFVJ55K4SFS2LFIU6WUPA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.136598413 (331h54m34.020012032s) [noise=true , address=104.36.82.4:4804 , piece_id=FPLZJ6A73CT5PZVRO3OC6EZSBAXNM6CXOT6XTIYYBXRMNBYKAPFQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.139429450 (331h54m34.022843071s) [noise=true , address=104.36.82.13:4185 , piece_id=FHAHCSM6CH7NAAEXJ6AXQ66CYFZDYRW3WHS4FAXKV33YNR4NVQ6Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.141510613 (331h54m34.024924241s) [noise=true , address=104.36.82.8:4969 , piece_id=C5QJAN5NDKHJTIP34QVAASOYVOPIOI6IPNWOJNJJRTGTKG77NOGQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.142778766 (331h54m34.026192379s) [noise=true , address=45.91.116.9:4262 , piece_id=PTG4BYTWSDDKVUFOQZSP3UD2GIPDTFPYB5MY26R5Y5J6RUHEO2OA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.144106582 (331h54m34.027520201s) [noise=true , address=45.91.116.10:4082 , piece_id=OXWX6ZAZXIOECVUBXSHLKFAZRJAGC2EQ2SIFKK7CVSGE5LNHNDZA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.145903774 (331h54m34.029317387s) [noise=true , address=77.90.31.15:4698 , piece_id=PCMESBSC4HNCBWCD6WGF2PHZIVMGRGPFVRLRPMN4SGXYRLAUVQGA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153002236 (331h54m34.036415855s) [noise=true , address=104.36.82.2:4732 , piece_id=QBDBIJZKVERWIFNLWGPP3O3O5WUA2IE2EM4J6FMZI4LJRUV4PLRQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: <nil>
Jul 7 05:05:34.153023193 (331h54m34.036436813s) [seg_pos={0 0}, upload=265414]: Segment reached optimal threshold of 13 pieces.
Jul 7 05:05:34.153141149 (331h54m34.036554768s) [noise=true , address=77.90.31.16:4735 , piece_id=HWDVRHMDQB5PAZXAYUBYVAAKHMYJT6AUT5FCL34YGO2MJB4EOH5Q, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153224298 (331h54m34.036637924s) [noise=true , address=77.90.31.21:4879 , piece_id=X2EDKJIGXSP5Z7UHA7MNRER6W752CIC46BVY4NZ4FKWUJ6CZVVOQ, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153312102 (331h54m34.036725732s) [noise=true , address=45.91.116.8:4048 , piece_id=75QHNIRIIYYFNQ6Y3TTF624DZOLSZLGQZH4343WG3RWOQZDBI3LA, seg_pos={0 0}, upload=265414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 7 05:05:34.153331573 (331h54m34.036745207s) [seg_pos={0 0}, upload=265414]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 7 05:05:34.153419868 (331h54m34.036833495s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 7 05:05:34.153426118 (331h54m34.036839747s) [upload=265414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 7 05:05:34.305750511 (331h54m34.189164132s) [upload=265414]: Done uploading segments...
Jul 7 05:05:34.305770972 (331h54m34.189184597s) [upload=265414]: Upload finished. err: <nil>
Jul 7 05:06:34.167245658 (331h55m34.050659278s) [upload=265425]: Starting upload
Jul 7 05:06:34.167323027 (331h55m34.050736656s) [upload=265425]: Done starting upload
Jul 7 05:06:34.167436646 (331h55m34.050850264s) [upload=265425]: Uploading segments...
Jul 7 05:06:34.167616451 (331h55m34.051030068s) [upload=265425]: Got next segment. Inline: false
Jul 7 05:06:34.167658114 (331h55m34.051071732s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 7 05:06:34.167665369 (331h55m34.051079014s) [upload=265425]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 7 05:07:03.886501092 (331h56m3.769914732s) [upload=265425]: Next segment err: context deadline exceeded
Jul 7 05:07:03.981435559 (331h56m3.86484919s) [upload=265425]: Done uploading segments...
Jul 7 05:07:03.981492080 (331h56m3.864905707s) [upload=265425]: Upload finished. err: context deadline exceeded
Duration: 2.286996737s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.247768666s
FAIL (2025-07-07 05:20:26 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 2.247985382s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
959.777031ms
FAIL (2025-07-07 05:20:08 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 959.876162ms
core
uplink
us1
|