Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.577463181s
FAIL (2025-10-15 05:45:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.577485707s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.3287757s
FAIL (2025-10-15 05:44:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.328821489s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.480898212s
FAIL (2025-10-15 05:44:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.480932817s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.322612717s
FAIL (2025-10-15 05:43:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.322649177s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.328215731s
FAIL (2025-10-15 05:43:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.328254253s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.336674514s
FAIL (2025-10-15 05:42:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.33670237s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.249989089s
FAIL (2025-10-15 05:41:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.250020157s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.366564538s
FAIL (2025-10-15 05:40:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.366597528s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.408136292s
FAIL (2025-10-15 05:39:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.408165557s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.32245192s
FAIL (2025-10-15 05:38:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.322501404s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.387047149s
FAIL (2025-10-15 05:37:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.387080142s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.300942754s
FAIL (2025-10-15 05:36:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.300976477s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.473881679s
FAIL (2025-10-15 05:35:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.473915835s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.656280155s
FAIL (2025-10-15 05:35:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.65632444s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.555981458s
FAIL (2025-10-15 05:34:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.556010688s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.520126087s
FAIL (2025-10-15 05:33:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.520176996s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.266113612s
FAIL (2025-10-15 05:32:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.266223627s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.234007301s
FAIL (2025-10-15 05:32:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.234050898s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.381999235s
FAIL (2025-10-15 05:31:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.382021441s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2m37.87281236s
FAIL (2025-10-15 05:31:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ce_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388673979 (519h59m2.192138583s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.388851257 (519h59m2.192315857s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389244033 (519h59m2.192708634s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389661370 (519h59m2.193125975s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.389749846 (519h59m2.193214447s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390018978 (519h59m2.19348357s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390174930 (519h59m2.193639524s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390397731 (519h59m2.193862333s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390581245 (519h59m2.19404584s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390798725 (519h59m2.194263323s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.390953070 (519h59m2.19441766s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391264585 (519h59m2.194729175s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391418776 (519h59m2.19488337s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391731431 (519h59m2.195196025s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.391805839 (519h59m2.195270436s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.392112296 (519h59m2.195576873s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Uploading piece...
Oct 15 05:29:14.941068796 (519h59m2.74453338s) [upload=457535]: Next returned nil segment
Oct 15 05:29:14.941086367 (519h59m2.74455096s) [upload=457535]: Waiting for error group managing segments...
Oct 15 05:29:15.088250132 (519h59m2.891714725s) [noise=true , address=145.79.227.42:4144 , piece_id=5IUNZ6ZVNIDZHAMCLD2AYIGTEJHRBPST4WLHVJYTRPL67MSAVICA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.092297990 (519h59m2.895762581s) [noise=true , address=145.79.227.27:4711 , piece_id=UAOWFGAYQH7KDDI24V2ZWHRIWL6HSSF6XKQVGKWIJ3KJ3KV4IXHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.093725465 (519h59m2.897190043s) [noise=true , address=77.90.31.14:4681 , piece_id=MCEOHK2M2H4ENQUOCT6KRNTQUOEGTLPEX5GZPDNLK4BIP74AMTGQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094251533 (519h59m2.897716124s) [noise=true , address=45.91.116.13:4169 , piece_id=C44ZWMJ5ULJ6RFVCCTG5W4IVDY6GZZBEC5BV7BCULABF3HAAY4TA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094334434 (519h59m2.897799025s) [noise=true , address=145.79.227.2:4148 , piece_id=RJU23JR4OK2Z2JRIR6WY4XEVI77J336WZEJEAIRO4HNWOXTK5S2Q, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.094364658 (519h59m2.897829239s) [noise=true , address=45.91.116.9:4272 , piece_id=S2VTZZFTJHC6RIFO6YD3LGHPZTTPZ2WS3IVSAZDSJIBVJ7KKY2HA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.096772776 (519h59m2.900237367s) [noise=true , address=45.91.116.10:4093 , piece_id=QXZY6V2EBQQRFIMBYUFJSYW6NK7QHLSIQOVXQLXVOYYPEOC3NIEQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.097602493 (519h59m2.901067072s) [noise=true , address=45.91.116.11:4132 , piece_id=23VEHPQBT6BHUQGS2QYQ2R7C7TKQTJCZA5JBLRNMSKFMVVILV2JA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.098827883 (519h59m2.90229246s) [noise=true , address=45.91.116.8:4065 , piece_id=BR5VDMS66FTOOGFI43KTLDDUJY6HDI2LX27JJ6X24L3MCMBWARVQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.099654467 (519h59m2.903119048s) [noise=true , address=77.90.31.11:4577 , piece_id=4E64KJED6RIDMAE4FCYVIL3BVVXDLR5XMYLVLQHFZIJGX4KAH5VQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.102513357 (519h59m2.905977935s) [noise=true , address=77.90.31.15:4731 , piece_id=FM4Q74VINLR5AGX5UQM2BGD3EFWFKUPIGKQUCXFTWPTMTLZYUQHQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103131293 (519h59m2.906595871s) [noise=true , address=45.91.116.12:4232 , piece_id=FWN65N5EXWX32A5EC46KDWQBJ6YVN5UGVCLU6JXRBSYZ4QKQKHYA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.103243670 (519h59m2.90670825s) [noise=true , address=45.91.116.14:4217 , piece_id=YOPQXQ4SSMWZKHP6IUW6TONGI2BPVQOIDVNSMYHJS2SNBWU4I7QQ, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106556416 (519h59m2.910020995s) [noise=true , address=77.90.31.19:4867 , piece_id=UV6F2IYFZ7L5VNKBM5UDDXQ4DLQZRG4VRT4AD6C3DNVL247XUN7A, seg_pos={0 0}, upload=457535]: Done uploading piece. err: <nil>
Oct 15 05:29:15.106577777 (519h59m2.910042367s) [seg_pos={0 0}, upload=457535]: Segment reached optimal threshold of 14 pieces.
Oct 15 05:29:15.106708373 (519h59m2.910172964s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106718569 (519h59m2.910183163s) [noise=true , address=45.91.116.6:4997 , piece_id=PITCZEYNCUB6TK6NQPPAMYNFBC5C3QRTOB5SCB6JUABAY5KEYXOA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106785559 (519h59m2.910250136s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106790166 (519h59m2.910254758s) [noise=true , address=145.79.227.33:4874 , piece_id=7X4SJQJZWFZG63IULMA5JASCO6MYYIWNWAFUETTRMEC5VX33HTZA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106865743 (519h59m2.910330334s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF
Oct 15 05:29:15.106872123 (519h59m2.910336717s) [noise=true , address=77.90.31.10:4524 , piece_id=EOVAC6ITQW72UR2GOA5WU3I2YDYIFHO45IS3NTUXV5A24F2TZLXA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106881066 (519h59m2.91034565s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vE9uZrGbtGAPxJtzwoowofHwtp3d5MeeJw7qzAtSCdzcrxzKf): protocol: read tcp 139.59.144.22:50048->64.49.13.139:4473: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 15 05:29:15.106893243 (519h59m2.910357834s) [noise=true , address=64.49.13.139:4473 , piece_id=G7E4UBE4CESCGBDOJV6PLSWBKWRPMPXMA2TNO2AY2FUOZV6DQDNA, seg_pos={0 0}, upload=457535]: Long tail cancellation due to optimal threshold
Oct 15 05:29:15.106914100 (519h59m2.91037868s) [seg_pos={0 0}, upload=457535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Oct 15 05:29:15.106982557 (519h59m2.910447149s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 15 05:29:15.106987608 (519h59m2.910452201s) [upload=457535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 15 05:31:51.851831078 (520h1m39.655295659s) [upload=457535]: Done uploading segments...
Oct 15 05:31:51.851852793 (520h1m39.655317376s) [upload=457535]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2m37.872835175s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
215.717951ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:21:48 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 215.843745ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
206.888674ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:21:04 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 206.985416ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
393.877896ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:20:33 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 393.905787ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
231.602241ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:19:39 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 231.630328ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
209.180924ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:18:36 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 209.204062ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
274.363502ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:18:02 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 274.398037ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
397.53996ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:17:12 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 397.56444ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
246.975802ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:16:49 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 247.008305ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
214.991097ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:16:24 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 215.02316ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
222.143822ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:16:01 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 222.174979ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..........X....] duration:
244.333581ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:15:25 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 244.387105ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...........X...] duration:
468.451366ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:14:52 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 468.489944ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [............X..] duration:
370.261551ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:14:08 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 370.285274ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.............X.] duration:
561.534648ms remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:13:52 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 561.565647ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..............X] duration:
43.319156515s remote:
"tcp:15.161.34.42:443" target:
https://www.storj.io/dcs-satellites
FAIL (2025-10-15 03:13:25 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": EOF
Duration: 43.319179248s
core
website
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
208.079198ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:11:20 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 208.120274ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
210.860659ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:10:06 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 210.892217ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
218.833329ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:09:46 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 218.864214ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
218.756195ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:09:16 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 218.797659ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.657528267s
FAIL (2025-10-14 01:09:14 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.657566984s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.779242157s
FAIL (2025-10-14 01:08:44 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.779276396s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.552422593s
FAIL (2025-10-14 01:08:26 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.552474516s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
215.506077ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:08:26 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 215.568524ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
218.206666ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:08:05 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 218.234729ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.74417697s
FAIL (2025-10-14 01:07:20 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.744284884s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
240.326414ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:07:12 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 240.356311ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.767781457s
FAIL (2025-10-14 01:06:37 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.767820891s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
314.205828ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:06:00 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 314.236296ms
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.602936943s
FAIL (2025-10-14 01:05:55 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.602980365s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
212.807972ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-10-14 01:05:18 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 212.843227ms
edge
linksharing
bgp
ap1
|