Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.141884362s FAIL (2025-07-18 11:14:32 UTC) orbiter warning: operation error S3: PutObject, request canceled, context deadline exceeded Duration: 1.141910921s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.162058944s FAIL (2025-07-18 11:13:50 UTC) orbiter warning: operation error S3: PutObject, request canceled, context deadline exceeded Duration: 1.162089824s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000338119s FAIL (2025-07-18 11:13:49 UTC) orbiter warning: operation error S3: PutObject, request canceled, context deadline exceeded Duration: 30.000364746s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.612693094s FAIL (2025-07-18 11:13:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.612725288s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.540545113s FAIL (2025-07-18 11:13:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.540574327s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X.....X.X..........] duration: 2.410298883s FAIL (2025-07-18 11:13:14 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.410332627s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X.....X.X.........] duration: 2.425290551s FAIL (2025-07-18 11:12:36 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.42531917s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.741194561s FAIL (2025-07-18 11:12:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.741230424s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X.....X.X........] duration: 2.36779128s FAIL (2025-07-18 11:12:13 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.367817059s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.655232997s FAIL (2025-07-18 11:11:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.655264601s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................................X.....X.X.......] duration: 2.359004121s FAIL (2025-07-18 11:11:25 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.359033917s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.700004864s FAIL (2025-07-18 11:11:04 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.700050206s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X.....X.X......] duration: 2.501700381s FAIL (2025-07-18 11:10:47 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.501731708s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.502178715s FAIL (2025-07-18 11:10:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.502204093s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................................X.....X.X.....] duration: 2.355918361s FAIL (2025-07-18 11:09:39 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.355948932s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.530363236s FAIL (2025-07-18 11:09:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.530390392s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................................X.....X.X....] duration: 2.386883944s FAIL (2025-07-18 11:08:44 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.386911204s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.536292442s FAIL (2025-07-18 11:08:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.536379783s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................................X.....X.X...] duration: 2.527677799s FAIL (2025-07-18 11:07:33 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.52771988s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.697229268s FAIL (2025-07-18 11:07:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.697264979s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.76250159s FAIL (2025-07-18 11:06:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.762592665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................................X.....X.X..] duration: 2.360939416s FAIL (2025-07-18 11:06:24 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.360970762s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 3.079243709s FAIL (2025-07-18 11:05:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 3.079337717s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................................X.....X.X.] duration: 2.375464885s FAIL (2025-07-18 11:05:32 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 2.375501347s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................................X.....X.X] duration: 30.001311697s FAIL (2025-07-18 11:05:04 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ailed to upload enough pieces (needed at least 13 but got 12) Jul 18 11:03:37.643679430 (601h52m37.52709306s) [upload=481236]: Starting upload Jul 18 11:03:37.643782391 (601h52m37.527196022s) [upload=481236]: Done starting upload Jul 18 11:03:37.644106454 (601h52m37.527520071s) [upload=481236]: Uploading segments... Jul 18 11:03:37.644436125 (601h52m37.527849743s) [upload=481236]: Got next segment. Inline: false Jul 18 11:03:37.644510191 (601h52m37.52792382s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:37.644517307 (601h52m37.527930933s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:37.810116494 (601h52m37.69353011s) [seg_pos={0 0}, upload=481236]: Begin upload segment... Jul 18 11:03:37.810164400 (601h52m37.693578018s) [seg_pos={0 0}, upload=481236]: Done begin upload segment. Jul 18 11:03:37.810196586 (601h52m37.693610212s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810231919 (601h52m37.693645555s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810580594 (601h52m37.693994221s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810685593 (601h52m37.694099225s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.810893735 (601h52m37.694307364s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811075809 (601h52m37.694489435s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811237104 (601h52m37.69465074s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811395128 (601h52m37.694808755s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811622171 (601h52m37.695035797s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.811753271 (601h52m37.6951669s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812117799 (601h52m37.695531426s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812214836 (601h52m37.695628465s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812445402 (601h52m37.695859041s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812586718 (601h52m37.696000345s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.812800680 (601h52m37.696214315s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:37.813196246 (601h52m37.696609877s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Uploading piece... Jul 18 11:03:38.414823406 (601h52m38.298237019s) [upload=481236]: Next returned nil segment Jul 18 11:03:38.414842305 (601h52m38.298255931s) [upload=481236]: Waiting for error group managing segments... Jul 18 11:03:38.553021358 (601h52m38.436434996s) [noise=true , address=45.91.116.5:4299 , piece_id=DIBL6O3LUBHY5LH73YY3Z4FQZGANS3GXFVEEW55S3OZV756KLZJA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.553509687 (601h52m38.436923306s) [noise=true , address=45.91.116.7:4010 , piece_id=TFEPUCA36DSN3A5VCZ2E37M67RMY6WYCKFXM36YYZJ67XAIFBIYQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.565669194 (601h52m38.44908284s) [noise=true , address=77.90.31.18:4807 , piece_id=WLMFGBCTD5YKAEK2WZFZ6ZXNFUP7VNJS7QBQYZXDKWHCODWNGZSA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.568477786 (601h52m38.451891401s) [noise=true , address=45.91.116.8:4047 , piece_id=VKV7YRCBME2M6WT7HH6CNP5HRID63WF2RNKJPROO3377UQ7XQAAA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.570640683 (601h52m38.454054302s) [noise=true , address=77.90.31.16:4734 , piece_id=IGFFDGYXJEAAU4KSH35WAXVLQAKV7F3BFM7JR4GKCCJUEEXA73GQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.571495658 (601h52m38.454909285s) [noise=true , address=77.90.31.14:4661 , piece_id=GGZXV37OUW4JHCQJBL65KQ5DXRHMG6WFZWNPKJA4YMKIE4LRQNXA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.573858038 (601h52m38.457271658s) [noise=true , address=77.90.31.15:4698 , piece_id=EYMZ424BLNSC2DPOAF4PRBNKSTBATQS6EQB2FYCLMKFNPI6N2SBQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.575247526 (601h52m38.458661139s) [noise=true , address=45.91.116.7:4009 , piece_id=ES2FN6ADEYXDUOL72HBN3KCAFLNZINSS4L5YHQEDXW5LOCDH43QQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.579075961 (601h52m38.46248958s) [noise=true , address=45.91.116.13:4154 , piece_id=TM6AC3Z6ONMEFXIGOSXV6WWG4UHPOK6IOKCJOPAQ6Z3R4J54W27Q, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.588622369 (601h52m38.472036002s) [noise=true , address=104.36.82.8:4971 , piece_id=3CAAALHRKI7QAOLZTSJQXFXECFROZ5VJGIX63TPGBTHNKJAKRGPA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.596999250 (601h52m38.480412869s) [noise=true , address=104.36.82.15:4258 , piece_id=2JIJJKSOSCEZTRATYAH6YGDARFN5LFY4KDM3NDIDXNDK4KNBMGQA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.597469819 (601h52m38.480883446s) [noise=true , address=104.36.82.11:4115 , piece_id=4CCTO4JRSIVUJVJ3P6XQ6AVMWTKNPJUA2EQ6XWYT3ZRM54VZZZ2A, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600923453 (601h52m38.48433708s) [noise=true , address=104.36.82.5:4840 , piece_id=23OSBWF3RYPMVJEBRHFS5HCXVLN7O5ZECCZRDLPLH5LGUOQUZRAQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: <nil> Jul 18 11:03:38.600948100 (601h52m38.484361727s) [seg_pos={0 0}, upload=481236]: Segment reached optimal threshold of 13 pieces. Jul 18 11:03:38.601183033 (601h52m38.48459665s) [noise=true , address=104.36.82.14:4222 , piece_id=PDY2SDGTP3JCPBVBIRWHIBUPKIJEPMOMBDTLWMG45EU7GEBFPNFA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601434248 (601h52m38.484847864s) [noise=true , address=104.36.82.7:4912 , piece_id=Q6XVUTUWKRXRSON3GCZFWVDTI7WF7ARZ6F75CWZ5PW7MZKZ2IVMQ, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Jul 18 11:03:38.601654820 (601h52m38.485068437s) [noise=true , address=77.90.31.17:4771 , piece_id=IIDNCVCSU6YXTKNFLZV6MBFIK43O7GORWL6IKZYEWC2ZE7MVURLA, seg_pos={0 0}, upload=481236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: context canceled; context canceled Jul 18 11:03:38.601677269 (601h52m38.485090884s) [seg_pos={0 0}, upload=481236]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:03:38.601827741 (601h52m38.485241379s) [upload=481236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:03:38.601835163 (601h52m38.485248797s) [upload=481236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:03:38.782141157 (601h52m38.665554846s) [upload=481236]: Done uploading segments... Jul 18 11:03:38.782185155 (601h52m38.665598786s) [upload=481236]: Upload finished. err: <nil> Jul 18 11:05:03.917588489 (601h54m3.801002112s) [upload=481255]: Starting upload Jul 18 11:05:03.917677038 (601h54m3.801090669s) [upload=481255]: Done starting upload Jul 18 11:05:03.918045490 (601h54m3.801459104s) [upload=481255]: Uploading segments... Jul 18 11:05:03.918133589 (601h54m3.801547274s) [upload=481255]: Got next segment. Inline: false Jul 18 11:05:03.918198428 (601h54m3.801612043s) [upload=481255]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:05:03.918205073 (601h54m3.801618689s) [upload=481255]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:05:04.844866527 (601h54m4.728280164s) [upload=481255]: Next segment err: context deadline exceeded Jul 18 11:05:04.845108015 (601h54m4.728521631s) [upload=481255]: Done uploading segments... Jul 18 11:05:04.845184412 (601h54m4.728598036s) [upload=481255]: Upload finished. err: context deadline exceeded Duration: 30.001341549s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.618861573s FAIL (2025-07-18 11:04:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.618911166s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 16.772298287s FAIL (2025-07-18 11:04:04 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 16.77233266s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...................................................X.....X.] duration: 2.508106728s FAIL (2025-07-18 11:03:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== }, upload=481219]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 139.59.144.22:60494->77.90.31.19:4841: use of closed network connection; context canceled Jul 18 11:02:07.474419910 (601h51m7.357833539s) [seg_pos={0 0}, upload=481219]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:02:07.474535184 (601h51m7.357948799s) [upload=481219]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:02:07.474540623 (601h51m7.357954244s) [upload=481219]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:02:07.821754173 (601h51m7.70516781s) [upload=481219]: Done uploading segments... Jul 18 11:02:07.821780401 (601h51m7.705194033s) [upload=481219]: Upload finished. err: <nil> Jul 18 11:03:02.341061788 (601h52m2.224475403s) [upload=481231]: Starting upload Jul 18 11:03:02.341159633 (601h52m2.224573256s) [upload=481231]: Done starting upload Jul 18 11:03:02.341413024 (601h52m2.22482666s) [upload=481231]: Uploading segments... Jul 18 11:03:02.341670080 (601h52m2.22508371s) [upload=481231]: Got next segment. Inline: false Jul 18 11:03:02.341729724 (601h52m2.225143342s) [upload=481231]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:02.341745216 (601h52m2.225158845s) [upload=481231]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:02.489190173 (601h52m2.372603813s) [seg_pos={0 0}, upload=481231]: Begin upload segment... Jul 18 11:03:02.489254600 (601h52m2.37266824s) [seg_pos={0 0}, upload=481231]: Done begin upload segment. Jul 18 11:03:02.489295530 (601h52m2.372709166s) [noise=true , address=77.90.31.18:4807 , piece_id=V23SNH7QCCR332TWKQ5I3A6AU6O3UAUZBSW2L3E3T75VPO6KMMUA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.489814638 (601h52m2.373228278s) [noise=true , address=77.90.31.12:4590 , piece_id=2Q5RKOITZWJU4VYAPOQXSXPCH7FTZSY3DEBAQ7A4CFPIHXME4OOQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.490537962 (601h52m2.373951591s) [noise=true , address=104.36.82.11:4114 , piece_id=UK2ROOYEYAXC7RECT3NQF6UXFGKPN273UTXCWFPW5HQVOWBPG6ZA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.491099067 (601h52m2.374512708s) [noise=true , address=45.91.116.10:4083 , piece_id=SR2SEDGXX7VP3CUAFXOCKAG3VKVGAX7NYMBE42LUQNPGBFYU7UMQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.491578054 (601h52m2.374991692s) [noise=true , address=104.36.82.12:4151 , piece_id=MCV3FP74TH255VQLM6MANEGXVDVPRSWQP4JM2CKWCLRRFD5ZT2LQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.492074695 (601h52m2.375488321s) [noise=true , address=45.91.116.8:4048 , piece_id=VY6XS7O6UA3GSBNM66VEICHXWZHBZN3BG5GKYSYMARLDJJGHAI5A, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.492599204 (601h52m2.376012845s) [noise=true , address=104.36.82.6:4875 , piece_id=YQQTBCC5VRNXM6O4FE4JLMGHI5WKZ5H4OWKZC3NZZ7NJKGRZ2THA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.493105537 (601h52m2.376519177s) [noise=true , address=104.36.82.14:4223 , piece_id=LKKFT3RSXLFSRPHWNKV7YFXEFQW5WT64OKNSOEDMSLRWUBDUA5TA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.493615802 (601h52m2.377029445s) [noise=true , address=77.90.31.11:4553 , piece_id=IUFZYEFQCQJC6TQ6Y4PWXGYJXTPXC26Y5S242Z56FKBBZF7NXLBQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.494143425 (601h52m2.377557064s) [noise=true , address=45.91.116.8:4047 , piece_id=L5VPSQGE4QEVYZUJ4XTEAJZLS5VTLADGIQYPZUDG7ZUEFZEKHKVQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.494635634 (601h52m2.378049274s) [noise=true , address=77.90.31.14:4663 , piece_id=NCAI43BQEY3Z4WLYLZJRT23RKVEEKWGQL3LGS4G6I3ZTJUPUF5EQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.495256816 (601h52m2.37867046s) [noise=true , address=104.36.82.13:4186 , piece_id=ODENVDAHMS64TV6FVXBK6MKDUU34ZHBORN2O34Y4RY3LDQSUPRZA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.495712261 (601h52m2.3791259s) [noise=true , address=104.36.82.10:4079 , piece_id=BGRPAEHZPCYWPDPAIYXQI6UNPZNU74735HN6UUB7MI7K35EVKMQA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.496137194 (601h52m2.379550831s) [noise=true , address=77.90.31.16:4733 , piece_id=GXCGDGFZCPHUVDLLSRXRBZF6RGMAA7IG7ZNRSNNLU4M63LGXXOQA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.498578847 (601h52m2.381992488s) [noise=true , address=45.91.116.4:4940 , piece_id=4HYXVO2BXMKVACF334TRHFVSUMQMJIU5ICE637MJXAY3BCVST3NQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.499191486 (601h52m2.382605126s) [noise=true , address=104.36.82.5:4839 , piece_id=WRJ4UWAZSEQLQETLPM7B2SIYNJPUVIJ6VVW3IALBHADZ3ZUCCG2A, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:03.191138352 (601h52m3.074551972s) [upload=481231]: Next returned nil segment Jul 18 11:03:03.191176554 (601h52m3.074590185s) [upload=481231]: Waiting for error group managing segments... Jul 18 11:03:03.307275406 (601h52m3.190689022s) [noise=true , address=45.91.116.10:4083 , piece_id=SR2SEDGXX7VP3CUAFXOCKAG3VKVGAX7NYMBE42LUQNPGBFYU7UMQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.323870769 (601h52m3.207284384s) [noise=true , address=45.91.116.8:4048 , piece_id=VY6XS7O6UA3GSBNM66VEICHXWZHBZN3BG5GKYSYMARLDJJGHAI5A, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.333346934 (601h52m3.216760572s) [noise=true , address=104.36.82.11:4114 , piece_id=UK2ROOYEYAXC7RECT3NQF6UXFGKPN273UTXCWFPW5HQVOWBPG6ZA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.334294389 (601h52m3.217708022s) [noise=true , address=104.36.82.14:4223 , piece_id=LKKFT3RSXLFSRPHWNKV7YFXEFQW5WT64OKNSOEDMSLRWUBDUA5TA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.344961558 (601h52m3.228375187s) [noise=true , address=45.91.116.4:4940 , piece_id=4HYXVO2BXMKVACF334TRHFVSUMQMJIU5ICE637MJXAY3BCVST3NQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.345670044 (601h52m3.229083676s) [noise=true , address=104.36.82.6:4875 , piece_id=YQQTBCC5VRNXM6O4FE4JLMGHI5WKZ5H4OWKZC3NZZ7NJKGRZ2THA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.356180412 (601h52m3.23959403s) [noise=true , address=77.90.31.16:4733 , piece_id=GXCGDGFZCPHUVDLLSRXRBZF6RGMAA7IG7ZNRSNNLU4M63LGXXOQA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.365080289 (601h52m3.248493917s) [noise=true , address=104.36.82.13:4186 , piece_id=ODENVDAHMS64TV6FVXBK6MKDUU34ZHBORN2O34Y4RY3LDQSUPRZA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.366282663 (601h52m3.249696298s) [noise=true , address=104.36.82.5:4839 , piece_id=WRJ4UWAZSEQLQETLPM7B2SIYNJPUVIJ6VVW3IALBHADZ3ZUCCG2A, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.383707254 (601h52m3.267120894s) [noise=true , address=104.36.82.10:4079 , piece_id=BGRPAEHZPCYWPDPAIYXQI6UNPZNU74735HN6UUB7MI7K35EVKMQA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.438304880 (601h52m3.321718499s) [noise=true , address=104.36.82.12:4151 , piece_id=MCV3FP74TH255VQLM6MANEGXVDVPRSWQP4JM2CKWCLRRFD5ZT2LQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:05.320350918 (601h52m5.203764534s) [noise=true , address=45.91.116.8:4047 , piece_id=L5VPSQGE4QEVYZUJ4XTEAJZLS5VTLADGIQYPZUDG7ZUEFZEKHKVQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:32.060004650 (601h52m31.943418277s) [noise=true , address=77.90.31.12:4590 , piece_id=2Q5RKOITZWJU4VYAPOQXSXPCH7FTZSY3DEBAQ7A4CFPIHXME4OOQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:52868->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060232800 (601h52m31.943646428s) [noise=true , address=77.90.31.14:4663 , piece_id=NCAI43BQEY3Z4WLYLZJRT23RKVEEKWGQL3LGS4G6I3ZTJUPUF5EQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 139.59.144.22:40564->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060243423 (601h52m31.94365704s) [noise=true , address=77.90.31.18:4807 , piece_id=V23SNH7QCCR332TWKQ5I3A6AU6O3UAUZBSW2L3E3T75VPO6KMMUA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: rpc: dial tcp 77.90.31.18:4807: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060279674 (601h52m31.943693302s) [noise=true , address=77.90.31.11:4553 , piece_id=IUFZYEFQCQJC6TQ6Y4PWXGYJXTPXC26Y5S242Z56FKBBZF7NXLBQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: rpc: dial tcp 77.90.31.11:4553: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060325409 (601h52m31.943739025s) [seg_pos={0 0}, upload=481231]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 11:03:32.203346569 (601h52m32.086760187s) [upload=481231]: Done uploading segments... Jul 18 11:03:32.203374029 (601h52m32.086787642s) [upload=481231]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.508133256s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...................................................X.....X] duration: 30.145214058s FAIL (2025-07-18 11:03:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== }, upload=481219]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 139.59.144.22:60494->77.90.31.19:4841: use of closed network connection; context canceled Jul 18 11:02:07.474419910 (601h51m7.357833539s) [seg_pos={0 0}, upload=481219]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 11:02:07.474535184 (601h51m7.357948799s) [upload=481219]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 11:02:07.474540623 (601h51m7.357954244s) [upload=481219]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 11:02:07.821754173 (601h51m7.70516781s) [upload=481219]: Done uploading segments... Jul 18 11:02:07.821780401 (601h51m7.705194033s) [upload=481219]: Upload finished. err: <nil> Jul 18 11:03:02.341061788 (601h52m2.224475403s) [upload=481231]: Starting upload Jul 18 11:03:02.341159633 (601h52m2.224573256s) [upload=481231]: Done starting upload Jul 18 11:03:02.341413024 (601h52m2.22482666s) [upload=481231]: Uploading segments... Jul 18 11:03:02.341670080 (601h52m2.22508371s) [upload=481231]: Got next segment. Inline: false Jul 18 11:03:02.341729724 (601h52m2.225143342s) [upload=481231]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 11:03:02.341745216 (601h52m2.225158845s) [upload=481231]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 11:03:02.489190173 (601h52m2.372603813s) [seg_pos={0 0}, upload=481231]: Begin upload segment... Jul 18 11:03:02.489254600 (601h52m2.37266824s) [seg_pos={0 0}, upload=481231]: Done begin upload segment. Jul 18 11:03:02.489295530 (601h52m2.372709166s) [noise=true , address=77.90.31.18:4807 , piece_id=V23SNH7QCCR332TWKQ5I3A6AU6O3UAUZBSW2L3E3T75VPO6KMMUA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.489814638 (601h52m2.373228278s) [noise=true , address=77.90.31.12:4590 , piece_id=2Q5RKOITZWJU4VYAPOQXSXPCH7FTZSY3DEBAQ7A4CFPIHXME4OOQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.490537962 (601h52m2.373951591s) [noise=true , address=104.36.82.11:4114 , piece_id=UK2ROOYEYAXC7RECT3NQF6UXFGKPN273UTXCWFPW5HQVOWBPG6ZA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.491099067 (601h52m2.374512708s) [noise=true , address=45.91.116.10:4083 , piece_id=SR2SEDGXX7VP3CUAFXOCKAG3VKVGAX7NYMBE42LUQNPGBFYU7UMQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.491578054 (601h52m2.374991692s) [noise=true , address=104.36.82.12:4151 , piece_id=MCV3FP74TH255VQLM6MANEGXVDVPRSWQP4JM2CKWCLRRFD5ZT2LQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.492074695 (601h52m2.375488321s) [noise=true , address=45.91.116.8:4048 , piece_id=VY6XS7O6UA3GSBNM66VEICHXWZHBZN3BG5GKYSYMARLDJJGHAI5A, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.492599204 (601h52m2.376012845s) [noise=true , address=104.36.82.6:4875 , piece_id=YQQTBCC5VRNXM6O4FE4JLMGHI5WKZ5H4OWKZC3NZZ7NJKGRZ2THA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.493105537 (601h52m2.376519177s) [noise=true , address=104.36.82.14:4223 , piece_id=LKKFT3RSXLFSRPHWNKV7YFXEFQW5WT64OKNSOEDMSLRWUBDUA5TA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.493615802 (601h52m2.377029445s) [noise=true , address=77.90.31.11:4553 , piece_id=IUFZYEFQCQJC6TQ6Y4PWXGYJXTPXC26Y5S242Z56FKBBZF7NXLBQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.494143425 (601h52m2.377557064s) [noise=true , address=45.91.116.8:4047 , piece_id=L5VPSQGE4QEVYZUJ4XTEAJZLS5VTLADGIQYPZUDG7ZUEFZEKHKVQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.494635634 (601h52m2.378049274s) [noise=true , address=77.90.31.14:4663 , piece_id=NCAI43BQEY3Z4WLYLZJRT23RKVEEKWGQL3LGS4G6I3ZTJUPUF5EQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.495256816 (601h52m2.37867046s) [noise=true , address=104.36.82.13:4186 , piece_id=ODENVDAHMS64TV6FVXBK6MKDUU34ZHBORN2O34Y4RY3LDQSUPRZA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.495712261 (601h52m2.3791259s) [noise=true , address=104.36.82.10:4079 , piece_id=BGRPAEHZPCYWPDPAIYXQI6UNPZNU74735HN6UUB7MI7K35EVKMQA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.496137194 (601h52m2.379550831s) [noise=true , address=77.90.31.16:4733 , piece_id=GXCGDGFZCPHUVDLLSRXRBZF6RGMAA7IG7ZNRSNNLU4M63LGXXOQA, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.498578847 (601h52m2.381992488s) [noise=true , address=45.91.116.4:4940 , piece_id=4HYXVO2BXMKVACF334TRHFVSUMQMJIU5ICE637MJXAY3BCVST3NQ, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:02.499191486 (601h52m2.382605126s) [noise=true , address=104.36.82.5:4839 , piece_id=WRJ4UWAZSEQLQETLPM7B2SIYNJPUVIJ6VVW3IALBHADZ3ZUCCG2A, seg_pos={0 0}, upload=481231]: Uploading piece... Jul 18 11:03:03.191138352 (601h52m3.074551972s) [upload=481231]: Next returned nil segment Jul 18 11:03:03.191176554 (601h52m3.074590185s) [upload=481231]: Waiting for error group managing segments... Jul 18 11:03:03.307275406 (601h52m3.190689022s) [noise=true , address=45.91.116.10:4083 , piece_id=SR2SEDGXX7VP3CUAFXOCKAG3VKVGAX7NYMBE42LUQNPGBFYU7UMQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.323870769 (601h52m3.207284384s) [noise=true , address=45.91.116.8:4048 , piece_id=VY6XS7O6UA3GSBNM66VEICHXWZHBZN3BG5GKYSYMARLDJJGHAI5A, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.333346934 (601h52m3.216760572s) [noise=true , address=104.36.82.11:4114 , piece_id=UK2ROOYEYAXC7RECT3NQF6UXFGKPN273UTXCWFPW5HQVOWBPG6ZA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.334294389 (601h52m3.217708022s) [noise=true , address=104.36.82.14:4223 , piece_id=LKKFT3RSXLFSRPHWNKV7YFXEFQW5WT64OKNSOEDMSLRWUBDUA5TA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.344961558 (601h52m3.228375187s) [noise=true , address=45.91.116.4:4940 , piece_id=4HYXVO2BXMKVACF334TRHFVSUMQMJIU5ICE637MJXAY3BCVST3NQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.345670044 (601h52m3.229083676s) [noise=true , address=104.36.82.6:4875 , piece_id=YQQTBCC5VRNXM6O4FE4JLMGHI5WKZ5H4OWKZC3NZZ7NJKGRZ2THA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.356180412 (601h52m3.23959403s) [noise=true , address=77.90.31.16:4733 , piece_id=GXCGDGFZCPHUVDLLSRXRBZF6RGMAA7IG7ZNRSNNLU4M63LGXXOQA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.365080289 (601h52m3.248493917s) [noise=true , address=104.36.82.13:4186 , piece_id=ODENVDAHMS64TV6FVXBK6MKDUU34ZHBORN2O34Y4RY3LDQSUPRZA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.366282663 (601h52m3.249696298s) [noise=true , address=104.36.82.5:4839 , piece_id=WRJ4UWAZSEQLQETLPM7B2SIYNJPUVIJ6VVW3IALBHADZ3ZUCCG2A, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.383707254 (601h52m3.267120894s) [noise=true , address=104.36.82.10:4079 , piece_id=BGRPAEHZPCYWPDPAIYXQI6UNPZNU74735HN6UUB7MI7K35EVKMQA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:03.438304880 (601h52m3.321718499s) [noise=true , address=104.36.82.12:4151 , piece_id=MCV3FP74TH255VQLM6MANEGXVDVPRSWQP4JM2CKWCLRRFD5ZT2LQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:05.320350918 (601h52m5.203764534s) [noise=true , address=45.91.116.8:4047 , piece_id=L5VPSQGE4QEVYZUJ4XTEAJZLS5VTLADGIQYPZUDG7ZUEFZEKHKVQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: <nil> Jul 18 11:03:32.060004650 (601h52m31.943418277s) [noise=true , address=77.90.31.12:4590 , piece_id=2Q5RKOITZWJU4VYAPOQXSXPCH7FTZSY3DEBAQ7A4CFPIHXME4OOQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:52868->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060232800 (601h52m31.943646428s) [noise=true , address=77.90.31.14:4663 , piece_id=NCAI43BQEY3Z4WLYLZJRT23RKVEEKWGQL3LGS4G6I3ZTJUPUF5EQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 139.59.144.22:40564->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060243423 (601h52m31.94365704s) [noise=true , address=77.90.31.18:4807 , piece_id=V23SNH7QCCR332TWKQ5I3A6AU6O3UAUZBSW2L3E3T75VPO6KMMUA, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: rpc: dial tcp 77.90.31.18:4807: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060279674 (601h52m31.943693302s) [noise=true , address=77.90.31.11:4553 , piece_id=IUFZYEFQCQJC6TQ6Y4PWXGYJXTPXC26Y5S242Z56FKBBZF7NXLBQ, seg_pos={0 0}, upload=481231]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: rpc: dial tcp 77.90.31.11:4553: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 11:03:32.060325409 (601h52m31.943739025s) [seg_pos={0 0}, upload=481231]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 11:03:32.203346569 (601h52m32.086760187s) [upload=481231]: Done uploading segments... Jul 18 11:03:32.203374029 (601h52m32.086787642s) [upload=481231]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.14527539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.754951846s FAIL (2025-07-18 11:03:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.75499474s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.561551507s FAIL (2025-07-18 11:02:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.561641416s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X...................................................X.....] duration: 2.579625692s FAIL (2025-07-18 11:02:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: context canceled; context canceled Jul 18 10:57:14.261359926 (601h46m14.144773537s) [seg_pos={0 0}, upload=481156]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:14.261496723 (601h46m14.144910352s) [upload=481156]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:14.261503942 (601h46m14.144917573s) [upload=481156]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:14.424528877 (601h46m14.307942505s) [upload=481156]: Done uploading segments... Jul 18 10:57:14.424550702 (601h46m14.307964321s) [upload=481156]: Upload finished. err: <nil> Jul 18 10:57:48.822879633 (601h46m48.70629326s) [upload=481168]: Starting upload Jul 18 10:57:48.822942615 (601h46m48.706356234s) [upload=481168]: Done starting upload Jul 18 10:57:48.823047974 (601h46m48.706461589s) [upload=481168]: Uploading segments... Jul 18 10:57:48.823315333 (601h46m48.706728945s) [upload=481168]: Got next segment. Inline: false Jul 18 10:57:48.823352648 (601h46m48.706766275s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:57:48.823357495 (601h46m48.706771121s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:57:49.017708607 (601h46m48.901122278s) [seg_pos={0 0}, upload=481168]: Begin upload segment... Jul 18 10:57:49.017788705 (601h46m48.901202321s) [seg_pos={0 0}, upload=481168]: Done begin upload segment. Jul 18 10:57:49.017814131 (601h46m48.901227763s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017832354 (601h46m48.901245983s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017939945 (601h46m48.901353574s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018407897 (601h46m48.901821532s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018424940 (601h46m48.90183857s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018797412 (601h46m48.902211038s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018890708 (601h46m48.902304345s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019141069 (601h46m48.902554698s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019320888 (601h46m48.902734506s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019517687 (601h46m48.902931319s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019902773 (601h46m48.9033164s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020322125 (601h46m48.903735754s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020621985 (601h46m48.904035606s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.022343379 (601h46m48.905757005s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023062600 (601h46m48.906476238s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023871294 (601h46m48.907284922s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.629298316 (601h46m49.512711946s) [upload=481168]: Next returned nil segment Jul 18 10:57:49.629349172 (601h46m49.512762802s) [upload=481168]: Waiting for error group managing segments... Jul 18 10:57:49.766556932 (601h46m49.649970568s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.767130239 (601h46m49.650543851s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769742516 (601h46m49.653156128s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769782119 (601h46m49.653195732s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770504127 (601h46m49.653917747s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770558068 (601h46m49.653971681s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.780765620 (601h46m49.664179251s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.786748714 (601h46m49.670162333s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.788631647 (601h46m49.672045281s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.792626839 (601h46m49.676040472s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.799812647 (601h46m49.683226264s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.802504860 (601h46m49.68591849s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812946039 (601h46m49.696359673s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812991202 (601h46m49.69640483s) [seg_pos={0 0}, upload=481168]: Segment reached optimal threshold of 13 pieces. Jul 18 10:57:49.813369712 (601h46m49.696783331s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jul 18 10:57:49.813437271 (601h46m49.696850884s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: context canceled; context canceled Jul 18 10:57:49.813531879 (601h46m49.696945492s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection Jul 18 10:57:49.813566339 (601h46m49.696979954s) [seg_pos={0 0}, upload=481168]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:49.813670983 (601h46m49.69708462s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:49.813677907 (601h46m49.697091543s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:49.964131356 (601h46m49.847544983s) [upload=481168]: Done uploading segments... Jul 18 10:57:49.964150203 (601h46m49.847563822s) [upload=481168]: Upload finished. err: <nil> Duration: 2.579653729s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.815510881s FAIL (2025-07-18 11:01:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.815543029s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X...................................................X....] duration: 2.371220247s FAIL (2025-07-18 11:01:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: context canceled; context canceled Jul 18 10:57:14.261359926 (601h46m14.144773537s) [seg_pos={0 0}, upload=481156]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:14.261496723 (601h46m14.144910352s) [upload=481156]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:14.261503942 (601h46m14.144917573s) [upload=481156]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:14.424528877 (601h46m14.307942505s) [upload=481156]: Done uploading segments... Jul 18 10:57:14.424550702 (601h46m14.307964321s) [upload=481156]: Upload finished. err: <nil> Jul 18 10:57:48.822879633 (601h46m48.70629326s) [upload=481168]: Starting upload Jul 18 10:57:48.822942615 (601h46m48.706356234s) [upload=481168]: Done starting upload Jul 18 10:57:48.823047974 (601h46m48.706461589s) [upload=481168]: Uploading segments... Jul 18 10:57:48.823315333 (601h46m48.706728945s) [upload=481168]: Got next segment. Inline: false Jul 18 10:57:48.823352648 (601h46m48.706766275s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:57:48.823357495 (601h46m48.706771121s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:57:49.017708607 (601h46m48.901122278s) [seg_pos={0 0}, upload=481168]: Begin upload segment... Jul 18 10:57:49.017788705 (601h46m48.901202321s) [seg_pos={0 0}, upload=481168]: Done begin upload segment. Jul 18 10:57:49.017814131 (601h46m48.901227763s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017832354 (601h46m48.901245983s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017939945 (601h46m48.901353574s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018407897 (601h46m48.901821532s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018424940 (601h46m48.90183857s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018797412 (601h46m48.902211038s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018890708 (601h46m48.902304345s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019141069 (601h46m48.902554698s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019320888 (601h46m48.902734506s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019517687 (601h46m48.902931319s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019902773 (601h46m48.9033164s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020322125 (601h46m48.903735754s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020621985 (601h46m48.904035606s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.022343379 (601h46m48.905757005s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023062600 (601h46m48.906476238s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023871294 (601h46m48.907284922s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.629298316 (601h46m49.512711946s) [upload=481168]: Next returned nil segment Jul 18 10:57:49.629349172 (601h46m49.512762802s) [upload=481168]: Waiting for error group managing segments... Jul 18 10:57:49.766556932 (601h46m49.649970568s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.767130239 (601h46m49.650543851s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769742516 (601h46m49.653156128s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769782119 (601h46m49.653195732s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770504127 (601h46m49.653917747s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770558068 (601h46m49.653971681s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.780765620 (601h46m49.664179251s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.786748714 (601h46m49.670162333s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.788631647 (601h46m49.672045281s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.792626839 (601h46m49.676040472s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.799812647 (601h46m49.683226264s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.802504860 (601h46m49.68591849s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812946039 (601h46m49.696359673s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812991202 (601h46m49.69640483s) [seg_pos={0 0}, upload=481168]: Segment reached optimal threshold of 13 pieces. Jul 18 10:57:49.813369712 (601h46m49.696783331s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jul 18 10:57:49.813437271 (601h46m49.696850884s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: context canceled; context canceled Jul 18 10:57:49.813531879 (601h46m49.696945492s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection Jul 18 10:57:49.813566339 (601h46m49.696979954s) [seg_pos={0 0}, upload=481168]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:49.813670983 (601h46m49.69708462s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:49.813677907 (601h46m49.697091543s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:49.964131356 (601h46m49.847544983s) [upload=481168]: Done uploading segments... Jul 18 10:57:49.964150203 (601h46m49.847563822s) [upload=481168]: Upload finished. err: <nil> Duration: 2.371246443s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X...................................................X...] duration: 2.335048655s FAIL (2025-07-18 11:00:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: context canceled; context canceled Jul 18 10:57:14.261359926 (601h46m14.144773537s) [seg_pos={0 0}, upload=481156]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:14.261496723 (601h46m14.144910352s) [upload=481156]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:14.261503942 (601h46m14.144917573s) [upload=481156]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:14.424528877 (601h46m14.307942505s) [upload=481156]: Done uploading segments... Jul 18 10:57:14.424550702 (601h46m14.307964321s) [upload=481156]: Upload finished. err: <nil> Jul 18 10:57:48.822879633 (601h46m48.70629326s) [upload=481168]: Starting upload Jul 18 10:57:48.822942615 (601h46m48.706356234s) [upload=481168]: Done starting upload Jul 18 10:57:48.823047974 (601h46m48.706461589s) [upload=481168]: Uploading segments... Jul 18 10:57:48.823315333 (601h46m48.706728945s) [upload=481168]: Got next segment. Inline: false Jul 18 10:57:48.823352648 (601h46m48.706766275s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:57:48.823357495 (601h46m48.706771121s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:57:49.017708607 (601h46m48.901122278s) [seg_pos={0 0}, upload=481168]: Begin upload segment... Jul 18 10:57:49.017788705 (601h46m48.901202321s) [seg_pos={0 0}, upload=481168]: Done begin upload segment. Jul 18 10:57:49.017814131 (601h46m48.901227763s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017832354 (601h46m48.901245983s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017939945 (601h46m48.901353574s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018407897 (601h46m48.901821532s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018424940 (601h46m48.90183857s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018797412 (601h46m48.902211038s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018890708 (601h46m48.902304345s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019141069 (601h46m48.902554698s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019320888 (601h46m48.902734506s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019517687 (601h46m48.902931319s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019902773 (601h46m48.9033164s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020322125 (601h46m48.903735754s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020621985 (601h46m48.904035606s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.022343379 (601h46m48.905757005s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023062600 (601h46m48.906476238s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023871294 (601h46m48.907284922s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.629298316 (601h46m49.512711946s) [upload=481168]: Next returned nil segment Jul 18 10:57:49.629349172 (601h46m49.512762802s) [upload=481168]: Waiting for error group managing segments... Jul 18 10:57:49.766556932 (601h46m49.649970568s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.767130239 (601h46m49.650543851s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769742516 (601h46m49.653156128s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769782119 (601h46m49.653195732s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770504127 (601h46m49.653917747s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770558068 (601h46m49.653971681s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.780765620 (601h46m49.664179251s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.786748714 (601h46m49.670162333s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.788631647 (601h46m49.672045281s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.792626839 (601h46m49.676040472s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.799812647 (601h46m49.683226264s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.802504860 (601h46m49.68591849s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812946039 (601h46m49.696359673s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812991202 (601h46m49.69640483s) [seg_pos={0 0}, upload=481168]: Segment reached optimal threshold of 13 pieces. Jul 18 10:57:49.813369712 (601h46m49.696783331s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jul 18 10:57:49.813437271 (601h46m49.696850884s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: context canceled; context canceled Jul 18 10:57:49.813531879 (601h46m49.696945492s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection Jul 18 10:57:49.813566339 (601h46m49.696979954s) [seg_pos={0 0}, upload=481168]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:49.813670983 (601h46m49.69708462s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:49.813677907 (601h46m49.697091543s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:49.964131356 (601h46m49.847544983s) [upload=481168]: Done uploading segments... Jul 18 10:57:49.964150203 (601h46m49.847563822s) [upload=481168]: Upload finished. err: <nil> Duration: 2.335078307s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.631051237s FAIL (2025-07-18 11:00:22 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.6310842s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X...................................................X..] duration: 3.082128863s FAIL (2025-07-18 11:00:01 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: context canceled; context canceled Jul 18 10:57:14.261359926 (601h46m14.144773537s) [seg_pos={0 0}, upload=481156]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:14.261496723 (601h46m14.144910352s) [upload=481156]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:14.261503942 (601h46m14.144917573s) [upload=481156]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:14.424528877 (601h46m14.307942505s) [upload=481156]: Done uploading segments... Jul 18 10:57:14.424550702 (601h46m14.307964321s) [upload=481156]: Upload finished. err: <nil> Jul 18 10:57:48.822879633 (601h46m48.70629326s) [upload=481168]: Starting upload Jul 18 10:57:48.822942615 (601h46m48.706356234s) [upload=481168]: Done starting upload Jul 18 10:57:48.823047974 (601h46m48.706461589s) [upload=481168]: Uploading segments... Jul 18 10:57:48.823315333 (601h46m48.706728945s) [upload=481168]: Got next segment. Inline: false Jul 18 10:57:48.823352648 (601h46m48.706766275s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:57:48.823357495 (601h46m48.706771121s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:57:49.017708607 (601h46m48.901122278s) [seg_pos={0 0}, upload=481168]: Begin upload segment... Jul 18 10:57:49.017788705 (601h46m48.901202321s) [seg_pos={0 0}, upload=481168]: Done begin upload segment. Jul 18 10:57:49.017814131 (601h46m48.901227763s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017832354 (601h46m48.901245983s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017939945 (601h46m48.901353574s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018407897 (601h46m48.901821532s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018424940 (601h46m48.90183857s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018797412 (601h46m48.902211038s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018890708 (601h46m48.902304345s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019141069 (601h46m48.902554698s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019320888 (601h46m48.902734506s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019517687 (601h46m48.902931319s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019902773 (601h46m48.9033164s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020322125 (601h46m48.903735754s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020621985 (601h46m48.904035606s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.022343379 (601h46m48.905757005s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023062600 (601h46m48.906476238s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023871294 (601h46m48.907284922s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.629298316 (601h46m49.512711946s) [upload=481168]: Next returned nil segment Jul 18 10:57:49.629349172 (601h46m49.512762802s) [upload=481168]: Waiting for error group managing segments... Jul 18 10:57:49.766556932 (601h46m49.649970568s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.767130239 (601h46m49.650543851s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769742516 (601h46m49.653156128s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769782119 (601h46m49.653195732s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770504127 (601h46m49.653917747s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770558068 (601h46m49.653971681s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.780765620 (601h46m49.664179251s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.786748714 (601h46m49.670162333s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.788631647 (601h46m49.672045281s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.792626839 (601h46m49.676040472s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.799812647 (601h46m49.683226264s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.802504860 (601h46m49.68591849s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812946039 (601h46m49.696359673s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812991202 (601h46m49.69640483s) [seg_pos={0 0}, upload=481168]: Segment reached optimal threshold of 13 pieces. Jul 18 10:57:49.813369712 (601h46m49.696783331s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jul 18 10:57:49.813437271 (601h46m49.696850884s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: context canceled; context canceled Jul 18 10:57:49.813531879 (601h46m49.696945492s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection Jul 18 10:57:49.813566339 (601h46m49.696979954s) [seg_pos={0 0}, upload=481168]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:49.813670983 (601h46m49.69708462s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:49.813677907 (601h46m49.697091543s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:49.964131356 (601h46m49.847544983s) [upload=481168]: Done uploading segments... Jul 18 10:57:49.964150203 (601h46m49.847563822s) [upload=481168]: Upload finished. err: <nil> Duration: 3.082161327s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.963848795s FAIL (2025-07-18 10:59:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 2.963881469s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X..........................................................X] duration: 1m0.004143793s FAIL (2025-07-18 10:59:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== HFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567267208 (601h46m53.450680834s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.567698610 (601h46m53.451112239s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.570842951 (601h46m53.454256585s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571148694 (601h46m53.454562307s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.571617590 (601h46m53.455031203s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572194976 (601h46m53.455608605s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.572657235 (601h46m53.45607085s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573103737 (601h46m53.456517363s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.573559498 (601h46m53.45697311s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.575230525 (601h46m53.458644152s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.576872259 (601h46m53.460285885s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.578624092 (601h46m53.462037718s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.580779720 (601h46m53.464193352s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.583021682 (601h46m53.466435301s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.584553497 (601h46m53.467967132s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.585102122 (601h46m53.468515755s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:53.586584733 (601h46m53.46999835s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Uploading piece... Jul 18 10:57:54.118272982 (601h46m54.001686609s) [upload=481170]: Next returned nil segment Jul 18 10:57:54.118290512 (601h46m54.001704132s) [upload=481170]: Waiting for error group managing segments... Jul 18 10:57:54.265678399 (601h46m54.149092018s) [noise=true , address=77.90.31.19:4849 , piece_id=2MY5DNKS7AAE3ME4SJ5XWXHGAICES3VH5SP4ADDJXEACDNCFUK7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.272591913 (601h46m54.156005531s) [noise=true , address=77.90.31.16:4760 , piece_id=SLUYYAF2AL4AA7UNV74LBEC6COPCNEDAU7Z6JJGP6NZQRA4QGGSA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.273166902 (601h46m54.156580518s) [noise=true , address=77.90.31.18:4821 , piece_id=ZT34UIRYSJR7W63UBZP5433JLLRI3LX2D7VYLDEJCSFU26VG4TGQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.275724342 (601h46m54.15913796s) [noise=true , address=45.91.116.5:4323 , piece_id=MBT6BQWV46PCBWY46DJF5WGQRMECQEMLXZNUIOB6HQ3KFD7ZRKIA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278917091 (601h46m54.162330707s) [noise=true , address=45.91.116.12:4259 , piece_id=4HL24ORSSTX5HQ6CA5HKDUF7GDK72ELCZIV44TR4J247FR7SH4RQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.278945616 (601h46m54.162359243s) [noise=true , address=45.91.116.14:4222 , piece_id=MML4PDHMCEIHAZVDC2DBP45HNBGFL3GKANZKTCWRRQSOXFLVGH7A, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.283715439 (601h46m54.167129051s) [noise=true , address=45.91.116.6:4998 , piece_id=K7R34IO3TUEZJWXXKYXMJNP6TU6UA4KXTFC43XQIQCHDSM6NYROQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.284438587 (601h46m54.167852208s) [noise=true , address=79.127.219.48:4104 , piece_id=DFY23S6CJXIV2TOK3DM7IIMNKVA5K4OONUMDKO7RZI3NJMXPAWYQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.294188062 (601h46m54.1776017s) [noise=true , address=104.36.82.50:4025 , piece_id=K6X7WBLMFJ2OHOGZU5KHUETOW6JF6MJKE7XT2NZ5NYATISG6ULSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.434300533 (601h46m54.317714163s) [noise=true , address=45.91.95.3:4022 , piece_id=STAZHFFZ2HSXVHPYQSXBJ2G3U3E5CC6ICEWRNJQ25W7LPBU7TNZA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.435093696 (601h46m54.318507314s) [noise=true , address=45.91.95.4:4002 , piece_id=TRN4JO4MDWIL7NLFRBGC2TKCVY2UFTQW2BRAZHIYVAO7JMIFMF4Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.436583511 (601h46m54.31999714s) [noise=true , address=45.91.95.4:4008 , piece_id=2YB4HUDGAOGDY4X4KQIJWX6CMNU3DOZ327MEFTRG5BDZSGKY7XLQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.451259425 (601h46m54.334673202s) [noise=true , address=45.91.95.2:4028 , piece_id=WPSVDMJBZOXWJA6ZYTBYUKMHWQEVNWTUXZL3U4K5MAXQVHJW5SBQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518816025 (601h46m54.402229644s) [noise=true , address=79.127.201.215:4349 , piece_id=YUZGMQNUXBHPGVJAIWNGHGIXKZKQHEWXWIZYGSBP5W4235FJA2PA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: <nil> Jul 18 10:57:54.518860075 (601h46m54.402273706s) [seg_pos={0 0}, upload=481170]: Segment reached optimal threshold of 14 pieces. Jul 18 10:57:54.519304291 (601h46m54.402717909s) [noise=true , address=79.127.205.234:4617 , piece_id=EYKK7F2UJYXWJPR6T2KXUPWW6KBZ22YIZETLYDZPF5GSLXAFNICA, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gUJcG8EBim135i6mRQQrwSBS5CFqVN5ipdFsGdWYH5Y9CxaUe): protocol: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49788->79.127.205.234:4617: use of closed network connection Jul 18 10:57:54.519319363 (601h46m54.402732994s) [noise=true , address=79.127.205.235:4685 , piece_id=PUFURTT4HVKI3VSZP3X33VD7ULRNLCNMXRMNKX4VZXF5ED5E6CSQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UK3CA8sureHVG8LghUPqYxYQgTY4gY7gaejKaMSBjbpY4kc1M): protocol: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53700->79.127.205.235:4685: use of closed network connection Jul 18 10:57:54.519384628 (601h46m54.402798246s) [noise=true , address=79.127.205.233:4647 , piece_id=NPEUREZXRRSGDPKJ5USSSRIOXEOYBYCRQVBAYNODPIZ7ABC47LWQ, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c19Vd3TVx59sX7RWYHvY99eMUQRqjJCyryCMZ5NdSdqeDQu9s): protocol: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46308->79.127.205.233:4647: use of closed network connection Jul 18 10:57:54.519402736 (601h46m54.402816368s) [noise=true , address=77.90.31.15:4704 , piece_id=NPGY5BTN46QRMZZXZHML3GZYGVBBFFTBSSCY4VGDCGGBKOSGFQ3Q, seg_pos={0 0}, upload=481170]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: write tcp 139.59.144.22:58638->77.90.31.15:4704: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:57:54.519432414 (601h46m54.402846045s) [seg_pos={0 0}, upload=481170]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 18 10:57:54.519523054 (601h46m54.40293687s) [upload=481170]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:54.519529627 (601h46m54.402943243s) [upload=481170]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:54.662927129 (601h46m54.546340748s) [upload=481170]: Done uploading segments... Jul 18 10:57:54.662950246 (601h46m54.546363866s) [upload=481170]: Upload finished. err: <nil> Duration: 1m0.004174691s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X...................................................X.] duration: 2.513892806s FAIL (2025-07-18 10:59:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: context canceled; context canceled Jul 18 10:57:14.261359926 (601h46m14.144773537s) [seg_pos={0 0}, upload=481156]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:14.261496723 (601h46m14.144910352s) [upload=481156]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:14.261503942 (601h46m14.144917573s) [upload=481156]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:14.424528877 (601h46m14.307942505s) [upload=481156]: Done uploading segments... Jul 18 10:57:14.424550702 (601h46m14.307964321s) [upload=481156]: Upload finished. err: <nil> Jul 18 10:57:48.822879633 (601h46m48.70629326s) [upload=481168]: Starting upload Jul 18 10:57:48.822942615 (601h46m48.706356234s) [upload=481168]: Done starting upload Jul 18 10:57:48.823047974 (601h46m48.706461589s) [upload=481168]: Uploading segments... Jul 18 10:57:48.823315333 (601h46m48.706728945s) [upload=481168]: Got next segment. Inline: false Jul 18 10:57:48.823352648 (601h46m48.706766275s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:57:48.823357495 (601h46m48.706771121s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:57:49.017708607 (601h46m48.901122278s) [seg_pos={0 0}, upload=481168]: Begin upload segment... Jul 18 10:57:49.017788705 (601h46m48.901202321s) [seg_pos={0 0}, upload=481168]: Done begin upload segment. Jul 18 10:57:49.017814131 (601h46m48.901227763s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017832354 (601h46m48.901245983s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017939945 (601h46m48.901353574s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018407897 (601h46m48.901821532s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018424940 (601h46m48.90183857s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018797412 (601h46m48.902211038s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018890708 (601h46m48.902304345s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019141069 (601h46m48.902554698s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019320888 (601h46m48.902734506s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019517687 (601h46m48.902931319s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019902773 (601h46m48.9033164s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020322125 (601h46m48.903735754s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020621985 (601h46m48.904035606s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.022343379 (601h46m48.905757005s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023062600 (601h46m48.906476238s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023871294 (601h46m48.907284922s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.629298316 (601h46m49.512711946s) [upload=481168]: Next returned nil segment Jul 18 10:57:49.629349172 (601h46m49.512762802s) [upload=481168]: Waiting for error group managing segments... Jul 18 10:57:49.766556932 (601h46m49.649970568s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.767130239 (601h46m49.650543851s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769742516 (601h46m49.653156128s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769782119 (601h46m49.653195732s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770504127 (601h46m49.653917747s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770558068 (601h46m49.653971681s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.780765620 (601h46m49.664179251s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.786748714 (601h46m49.670162333s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.788631647 (601h46m49.672045281s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.792626839 (601h46m49.676040472s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.799812647 (601h46m49.683226264s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.802504860 (601h46m49.68591849s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812946039 (601h46m49.696359673s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812991202 (601h46m49.69640483s) [seg_pos={0 0}, upload=481168]: Segment reached optimal threshold of 13 pieces. Jul 18 10:57:49.813369712 (601h46m49.696783331s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jul 18 10:57:49.813437271 (601h46m49.696850884s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: context canceled; context canceled Jul 18 10:57:49.813531879 (601h46m49.696945492s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection Jul 18 10:57:49.813566339 (601h46m49.696979954s) [seg_pos={0 0}, upload=481168]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:49.813670983 (601h46m49.69708462s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:49.813677907 (601h46m49.697091543s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:49.964131356 (601h46m49.847544983s) [upload=481168]: Done uploading segments... Jul 18 10:57:49.964150203 (601h46m49.847563822s) [upload=481168]: Upload finished. err: <nil> Duration: 2.513915404s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X...................................................X] duration: 30.000708773s FAIL (2025-07-18 10:59:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: context canceled; context canceled Jul 18 10:57:14.261359926 (601h46m14.144773537s) [seg_pos={0 0}, upload=481156]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:14.261496723 (601h46m14.144910352s) [upload=481156]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:14.261503942 (601h46m14.144917573s) [upload=481156]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:14.424528877 (601h46m14.307942505s) [upload=481156]: Done uploading segments... Jul 18 10:57:14.424550702 (601h46m14.307964321s) [upload=481156]: Upload finished. err: <nil> Jul 18 10:57:48.822879633 (601h46m48.70629326s) [upload=481168]: Starting upload Jul 18 10:57:48.822942615 (601h46m48.706356234s) [upload=481168]: Done starting upload Jul 18 10:57:48.823047974 (601h46m48.706461589s) [upload=481168]: Uploading segments... Jul 18 10:57:48.823315333 (601h46m48.706728945s) [upload=481168]: Got next segment. Inline: false Jul 18 10:57:48.823352648 (601h46m48.706766275s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:57:48.823357495 (601h46m48.706771121s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:57:49.017708607 (601h46m48.901122278s) [seg_pos={0 0}, upload=481168]: Begin upload segment... Jul 18 10:57:49.017788705 (601h46m48.901202321s) [seg_pos={0 0}, upload=481168]: Done begin upload segment. Jul 18 10:57:49.017814131 (601h46m48.901227763s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017832354 (601h46m48.901245983s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.017939945 (601h46m48.901353574s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018407897 (601h46m48.901821532s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018424940 (601h46m48.90183857s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018797412 (601h46m48.902211038s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.018890708 (601h46m48.902304345s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019141069 (601h46m48.902554698s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019320888 (601h46m48.902734506s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019517687 (601h46m48.902931319s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.019902773 (601h46m48.9033164s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020322125 (601h46m48.903735754s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.020621985 (601h46m48.904035606s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.022343379 (601h46m48.905757005s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023062600 (601h46m48.906476238s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.023871294 (601h46m48.907284922s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Uploading piece... Jul 18 10:57:49.629298316 (601h46m49.512711946s) [upload=481168]: Next returned nil segment Jul 18 10:57:49.629349172 (601h46m49.512762802s) [upload=481168]: Waiting for error group managing segments... Jul 18 10:57:49.766556932 (601h46m49.649970568s) [noise=true , address=45.91.116.9:4261 , piece_id=KIR7YFJHWW54RGGDHNHPV4NBLV2MON3DTWMTVRZDPKCMN74XXMIQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.767130239 (601h46m49.650543851s) [noise=true , address=45.91.116.4:4938 , piece_id=E4I6ZO56AFA45OASIZTRP7IF3QMUMW27NDYBKMOKMHDSUJ7USXWQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769742516 (601h46m49.653156128s) [noise=true , address=45.91.116.5:4299 , piece_id=2LEFPRVQ3MLMBMD4HB2OBV65UHO623MZPBBJQZ4P7XV5XLGZXJ3A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.769782119 (601h46m49.653195732s) [noise=true , address=77.90.31.12:4589 , piece_id=GVPDXZYJ37RYLRALIAE564S7LWMLEWLG4O3GDJBW7ZJMEALA6X5Q, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770504127 (601h46m49.653917747s) [noise=true , address=77.90.31.19:4841 , piece_id=QSQMZEM4UL4L3NNVZ6ADB2ULHUKQI27Z4SDYR4F6OTLJPO7YEQAA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.770558068 (601h46m49.653971681s) [noise=true , address=45.91.116.11:4118 , piece_id=O6GJPWVQMRLGJYOPXAIHIKYHEVNVBTAFCPPZGY6GUVV5NNNCUK5A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.780765620 (601h46m49.664179251s) [noise=true , address=45.91.116.6:4975 , piece_id=LHUKP3WNU7ANDKLXYUXOVXL3ABMECRNRHJRKHHHVLJLGCZAG6MUA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.786748714 (601h46m49.670162333s) [noise=true , address=45.91.116.9:4263 , piece_id=LG6N7WKEENL2AQLNRGB5WXBB5RURLN4I7KR3P25NK4GP6HFXI2ZA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.788631647 (601h46m49.672045281s) [noise=true , address=45.91.116.10:4083 , piece_id=4B3HNUFUWX4SYDEOWQCLKLLPIDIQ3VDBCG5EF462NJBXZWR27RIA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.792626839 (601h46m49.676040472s) [noise=true , address=104.36.82.9:4007 , piece_id=73ZV5XE5YYV4F2NNNV3T27MDKMW5MMKA4UA7KT7LGMUEN47Q6EMA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.799812647 (601h46m49.683226264s) [noise=true , address=104.36.82.6:4874 , piece_id=4E3YDQA7ORHS2G3MFMCVYCO2AQ63XCE2NR7FWMBB3CVRKTGAUZEQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.802504860 (601h46m49.68591849s) [noise=true , address=104.36.82.14:4221 , piece_id=KHL3PUP7ORHBULHU2DSXD2F24ASBSSZA3FAZLPOCVYPM3MHOI24A, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812946039 (601h46m49.696359673s) [noise=true , address=104.36.82.16:4294 , piece_id=WEBONGQVBIW7HYJ2HQHPA4OYZWRSGHUCBMN6F7N6Y7IVM2R3KCGQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: <nil> Jul 18 10:57:49.812991202 (601h46m49.69640483s) [seg_pos={0 0}, upload=481168]: Segment reached optimal threshold of 13 pieces. Jul 18 10:57:49.813369712 (601h46m49.696783331s) [noise=true , address=104.36.82.15:4258 , piece_id=WP2U6F7IBTWB6HDN6RIKHTLJXNVJFZ5SB6XEKEDB5RAVBXJBFPAQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jul 18 10:57:49.813437271 (601h46m49.696850884s) [noise=true , address=77.90.31.14:4661 , piece_id=XSSUDLTUXIBNGJPOG65474YSWICTAWG3EYWBBF42PYZRBX7WTMPA, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: context canceled; context canceled Jul 18 10:57:49.813531879 (601h46m49.696945492s) [noise=true , address=45.91.116.8:4045 , piece_id=BYZKJ2BBA3QXYYNFUG37CZTC46WUEUB3TJBYQNLS5KU7Z6YFT4XQ, seg_pos={0 0}, upload=481168]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48622->45.91.116.8:4045: use of closed network connection Jul 18 10:57:49.813566339 (601h46m49.696979954s) [seg_pos={0 0}, upload=481168]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 10:57:49.813670983 (601h46m49.69708462s) [upload=481168]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:57:49.813677907 (601h46m49.697091543s) [upload=481168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:57:49.964131356 (601h46m49.847544983s) [upload=481168]: Done uploading segments... Jul 18 10:57:49.964150203 (601h46m49.847563822s) [upload=481168]: Upload finished. err: <nil> Duration: 30.000729624s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.555674873s FAIL (2025-07-18 10:57:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.555702127s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.442489219s FAIL (2025-07-18 10:57:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 480650]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:18:47.533942446 (601h7m47.417356079s) [upload=480650]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:18:47.812231852 (601h7m47.695645478s) [upload=480650]: Done uploading segments... Jul 18 10:18:47.812262386 (601h7m47.695676006s) [upload=480650]: Upload finished. err: <nil> Jul 18 10:19:55.918921928 (601h8m55.802335557s) [upload=480662]: Starting upload Jul 18 10:19:55.919029214 (601h8m55.802442841s) [upload=480662]: Done starting upload Jul 18 10:19:55.919155429 (601h8m55.802569051s) [upload=480662]: Uploading segments... Jul 18 10:19:55.919515206 (601h8m55.802928835s) [upload=480662]: Got next segment. Inline: false Jul 18 10:19:55.919571748 (601h8m55.802985369s) [upload=480662]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:19:55.919578101 (601h8m55.802991727s) [upload=480662]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:19:56.031248080 (601h8m55.914661696s) [seg_pos={0 0}, upload=480662]: Begin upload segment... Jul 18 10:19:56.031292240 (601h8m55.914705855s) [seg_pos={0 0}, upload=480662]: Done begin upload segment. Jul 18 10:19:56.031317268 (601h8m55.914730898s) [noise=true , address=104.36.82.15:4257 , piece_id=ZLRHK52WBIITKAN7XL3IXRUXARJZHG4MBYCNKQKAEDZM3LO4SZCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031351551 (601h8m55.914765183s) [noise=true , address=77.90.31.11:4554 , piece_id=TMJCTAKQSBU43GAPDKFRO4CV25F3NUSXLRR3BHJYWGJHLAH6U2GA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031690493 (601h8m55.915104123s) [noise=true , address=104.36.82.2:4731 , piece_id=QL3J2KZ7JSL6XCT7BEBTICYDNO7J46BKMFWGVZGHFXHL4HJCJMCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031812851 (601h8m55.915226478s) [noise=true , address=77.90.31.10:4519 , piece_id=BGSDLEI6DGABQ6MPE6MKB3GQTSZFCLU2SMHXOYOTJAXIPOPPQUMA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031989185 (601h8m55.915402815s) [noise=true , address=45.91.116.8:4048 , piece_id=CGRSYOZRYATMSMSUFQOJWVCRXSTH4XNIHOPLHB2SO3LKPA7VYHUA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032350596 (601h8m55.915764228s) [noise=true , address=104.36.82.14:4222 , piece_id=UEDV5F73GO5VVWRS6OUFFU4DC5KH2E7J6ORUAS6ENH6X3JASIOSQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032484269 (601h8m55.915897899s) [noise=true , address=77.90.31.13:4627 , piece_id=ET6E4UJJY4BED3BF6OMIR7M3FUUQI2HS6EXBETDW5VZ7A4TKY63A, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032667765 (601h8m55.916081392s) [noise=true , address=77.90.31.19:4842 , piece_id=C3PIB4BNPDUDFVCE7CUBBCJEJVXMST2HG5FRYN4GMKQNEGMKZQCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032790153 (601h8m55.916203782s) [noise=true , address=77.90.31.17:4771 , piece_id=DTFPLMPZCBZAEXQQVIHFAXYDCPQLV7RTSLTG5LZ3R4JWW6VFOIFA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032975878 (601h8m55.916389503s) [noise=true , address=77.90.31.19:4843 , piece_id=35FVX7VL3RSJJSJYB6B63XDL7KBURU6LKWDE2EUOM4YHX477DQHA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033092815 (601h8m55.916506452s) [noise=true , address=77.90.31.16:4734 , piece_id=OZOFFS3ATHKYAQX5IF3N7ZLBFEIRPPCQKFWJBGPSSB4PL4ZKGYLA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033265110 (601h8m55.916678735s) [noise=true , address=77.90.31.14:4662 , piece_id=PQEQRAMXQ6ISPUEGVC7H3QBW4RGELHSQRVGZ73ZN7S2MYIK4DK2Q, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033381530 (601h8m55.91679516s) [noise=true , address=45.91.116.11:4117 , piece_id=JQEYTY2QX7PEGBA2HB3S3YHBN6BLM7JJ7ZMRROC6RPTTHKVZGPPA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033556914 (601h8m55.91697054s) [noise=true , address=77.90.31.18:4806 , piece_id=NO4NHTDSAH4UUNLH4JF4WVJOVTH5YYN3MLXH6MJZLB5L7VPTN36A, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033711089 (601h8m55.917124725s) [noise=true , address=45.91.116.6:4973 , piece_id=HP3EHZ7DTMK5NROFME4BB6L35GNHP4BUZ7GXMMMHNQNE5QIBQNRA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.034072226 (601h8m55.91748586s) [noise=true , address=104.36.82.13:4186 , piece_id=PKBR6JU3XOQDZVW2L6XSE3PBJCYNIHJFF7QAZGU5L32ATPCT2WQA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.636472896 (601h8m56.519886527s) [upload=480662]: Next returned nil segment Jul 18 10:19:56.636496664 (601h8m56.51991028s) [upload=480662]: Waiting for error group managing segments... Jul 18 10:19:56.771748829 (601h8m56.655162461s) [noise=true , address=77.90.31.18:4806 , piece_id=NO4NHTDSAH4UUNLH4JF4WVJOVTH5YYN3MLXH6MJZLB5L7VPTN36A, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.774291101 (601h8m56.657704713s) [noise=true , address=77.90.31.14:4662 , piece_id=PQEQRAMXQ6ISPUEGVC7H3QBW4RGELHSQRVGZ73ZN7S2MYIK4DK2Q, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.777786273 (601h8m56.661199903s) [noise=true , address=45.91.116.6:4973 , piece_id=HP3EHZ7DTMK5NROFME4BB6L35GNHP4BUZ7GXMMMHNQNE5QIBQNRA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.792902845 (601h8m56.676316463s) [noise=true , address=45.91.116.8:4048 , piece_id=CGRSYOZRYATMSMSUFQOJWVCRXSTH4XNIHOPLHB2SO3LKPA7VYHUA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.793108817 (601h8m56.676522435s) [noise=true , address=45.91.116.11:4117 , piece_id=JQEYTY2QX7PEGBA2HB3S3YHBN6BLM7JJ7ZMRROC6RPTTHKVZGPPA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.798027666 (601h8m56.6814413s) [noise=true , address=77.90.31.19:4842 , piece_id=C3PIB4BNPDUDFVCE7CUBBCJEJVXMST2HG5FRYN4GMKQNEGMKZQCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.801662815 (601h8m56.685076444s) [noise=true , address=104.36.82.15:4257 , piece_id=ZLRHK52WBIITKAN7XL3IXRUXARJZHG4MBYCNKQKAEDZM3LO4SZCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.807815370 (601h8m56.691229003s) [noise=true , address=104.36.82.13:4186 , piece_id=PKBR6JU3XOQDZVW2L6XSE3PBJCYNIHJFF7QAZGU5L32ATPCT2WQA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.816684873 (601h8m56.700098485s) [noise=true , address=104.36.82.2:4731 , piece_id=QL3J2KZ7JSL6XCT7BEBTICYDNO7J46BKMFWGVZGHFXHL4HJCJMCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.822376971 (601h8m56.705790598s) [noise=true , address=104.36.82.14:4222 , piece_id=UEDV5F73GO5VVWRS6OUFFU4DC5KH2E7J6ORUAS6ENH6X3JASIOSQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:20:25.646275878 (601h9m25.529689504s) [noise=true , address=77.90.31.11:4554 , piece_id=TMJCTAKQSBU43GAPDKFRO4CV25F3NUSXLRR3BHJYWGJHLAH6U2GA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646361211 (601h9m25.529774832s) [noise=true , address=77.90.31.13:4627 , piece_id=ET6E4UJJY4BED3BF6OMIR7M3FUUQI2HS6EXBETDW5VZ7A4TKY63A, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:40210->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646422784 (601h9m25.529836403s) [noise=true , address=77.90.31.17:4771 , piece_id=DTFPLMPZCBZAEXQQVIHFAXYDCPQLV7RTSLTG5LZ3R4JWW6VFOIFA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 139.59.144.22:54416->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646498682 (601h9m25.529912301s) [noise=true , address=77.90.31.16:4734 , piece_id=OZOFFS3ATHKYAQX5IF3N7ZLBFEIRPPCQKFWJBGPSSB4PL4ZKGYLA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:35464->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646512514 (601h9m25.529926133s) [noise=true , address=77.90.31.19:4843 , piece_id=35FVX7VL3RSJJSJYB6B63XDL7KBURU6LKWDE2EUOM4YHX477DQHA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: rpc: dial tcp 77.90.31.19:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646569038 (601h9m25.529982655s) [noise=true , address=77.90.31.10:4519 , piece_id=BGSDLEI6DGABQ6MPE6MKB3GQTSZFCLU2SMHXOYOTJAXIPOPPQUMA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646604894 (601h9m25.530018531s) [seg_pos={0 0}, upload=480662]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 18 10:20:25.770785641 (601h9m25.654199264s) [upload=480662]: Done uploading segments... Jul 18 10:20:25.770811727 (601h9m25.654225346s) [upload=480662]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.442508557s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.744156103s FAIL (2025-07-18 10:57:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.74418825s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.342093776s FAIL (2025-07-18 10:57:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 480650]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:18:47.533942446 (601h7m47.417356079s) [upload=480650]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:18:47.812231852 (601h7m47.695645478s) [upload=480650]: Done uploading segments... Jul 18 10:18:47.812262386 (601h7m47.695676006s) [upload=480650]: Upload finished. err: <nil> Jul 18 10:19:55.918921928 (601h8m55.802335557s) [upload=480662]: Starting upload Jul 18 10:19:55.919029214 (601h8m55.802442841s) [upload=480662]: Done starting upload Jul 18 10:19:55.919155429 (601h8m55.802569051s) [upload=480662]: Uploading segments... Jul 18 10:19:55.919515206 (601h8m55.802928835s) [upload=480662]: Got next segment. Inline: false Jul 18 10:19:55.919571748 (601h8m55.802985369s) [upload=480662]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:19:55.919578101 (601h8m55.802991727s) [upload=480662]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:19:56.031248080 (601h8m55.914661696s) [seg_pos={0 0}, upload=480662]: Begin upload segment... Jul 18 10:19:56.031292240 (601h8m55.914705855s) [seg_pos={0 0}, upload=480662]: Done begin upload segment. Jul 18 10:19:56.031317268 (601h8m55.914730898s) [noise=true , address=104.36.82.15:4257 , piece_id=ZLRHK52WBIITKAN7XL3IXRUXARJZHG4MBYCNKQKAEDZM3LO4SZCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031351551 (601h8m55.914765183s) [noise=true , address=77.90.31.11:4554 , piece_id=TMJCTAKQSBU43GAPDKFRO4CV25F3NUSXLRR3BHJYWGJHLAH6U2GA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031690493 (601h8m55.915104123s) [noise=true , address=104.36.82.2:4731 , piece_id=QL3J2KZ7JSL6XCT7BEBTICYDNO7J46BKMFWGVZGHFXHL4HJCJMCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031812851 (601h8m55.915226478s) [noise=true , address=77.90.31.10:4519 , piece_id=BGSDLEI6DGABQ6MPE6MKB3GQTSZFCLU2SMHXOYOTJAXIPOPPQUMA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031989185 (601h8m55.915402815s) [noise=true , address=45.91.116.8:4048 , piece_id=CGRSYOZRYATMSMSUFQOJWVCRXSTH4XNIHOPLHB2SO3LKPA7VYHUA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032350596 (601h8m55.915764228s) [noise=true , address=104.36.82.14:4222 , piece_id=UEDV5F73GO5VVWRS6OUFFU4DC5KH2E7J6ORUAS6ENH6X3JASIOSQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032484269 (601h8m55.915897899s) [noise=true , address=77.90.31.13:4627 , piece_id=ET6E4UJJY4BED3BF6OMIR7M3FUUQI2HS6EXBETDW5VZ7A4TKY63A, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032667765 (601h8m55.916081392s) [noise=true , address=77.90.31.19:4842 , piece_id=C3PIB4BNPDUDFVCE7CUBBCJEJVXMST2HG5FRYN4GMKQNEGMKZQCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032790153 (601h8m55.916203782s) [noise=true , address=77.90.31.17:4771 , piece_id=DTFPLMPZCBZAEXQQVIHFAXYDCPQLV7RTSLTG5LZ3R4JWW6VFOIFA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032975878 (601h8m55.916389503s) [noise=true , address=77.90.31.19:4843 , piece_id=35FVX7VL3RSJJSJYB6B63XDL7KBURU6LKWDE2EUOM4YHX477DQHA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033092815 (601h8m55.916506452s) [noise=true , address=77.90.31.16:4734 , piece_id=OZOFFS3ATHKYAQX5IF3N7ZLBFEIRPPCQKFWJBGPSSB4PL4ZKGYLA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033265110 (601h8m55.916678735s) [noise=true , address=77.90.31.14:4662 , piece_id=PQEQRAMXQ6ISPUEGVC7H3QBW4RGELHSQRVGZ73ZN7S2MYIK4DK2Q, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033381530 (601h8m55.91679516s) [noise=true , address=45.91.116.11:4117 , piece_id=JQEYTY2QX7PEGBA2HB3S3YHBN6BLM7JJ7ZMRROC6RPTTHKVZGPPA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033556914 (601h8m55.91697054s) [noise=true , address=77.90.31.18:4806 , piece_id=NO4NHTDSAH4UUNLH4JF4WVJOVTH5YYN3MLXH6MJZLB5L7VPTN36A, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033711089 (601h8m55.917124725s) [noise=true , address=45.91.116.6:4973 , piece_id=HP3EHZ7DTMK5NROFME4BB6L35GNHP4BUZ7GXMMMHNQNE5QIBQNRA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.034072226 (601h8m55.91748586s) [noise=true , address=104.36.82.13:4186 , piece_id=PKBR6JU3XOQDZVW2L6XSE3PBJCYNIHJFF7QAZGU5L32ATPCT2WQA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.636472896 (601h8m56.519886527s) [upload=480662]: Next returned nil segment Jul 18 10:19:56.636496664 (601h8m56.51991028s) [upload=480662]: Waiting for error group managing segments... Jul 18 10:19:56.771748829 (601h8m56.655162461s) [noise=true , address=77.90.31.18:4806 , piece_id=NO4NHTDSAH4UUNLH4JF4WVJOVTH5YYN3MLXH6MJZLB5L7VPTN36A, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.774291101 (601h8m56.657704713s) [noise=true , address=77.90.31.14:4662 , piece_id=PQEQRAMXQ6ISPUEGVC7H3QBW4RGELHSQRVGZ73ZN7S2MYIK4DK2Q, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.777786273 (601h8m56.661199903s) [noise=true , address=45.91.116.6:4973 , piece_id=HP3EHZ7DTMK5NROFME4BB6L35GNHP4BUZ7GXMMMHNQNE5QIBQNRA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.792902845 (601h8m56.676316463s) [noise=true , address=45.91.116.8:4048 , piece_id=CGRSYOZRYATMSMSUFQOJWVCRXSTH4XNIHOPLHB2SO3LKPA7VYHUA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.793108817 (601h8m56.676522435s) [noise=true , address=45.91.116.11:4117 , piece_id=JQEYTY2QX7PEGBA2HB3S3YHBN6BLM7JJ7ZMRROC6RPTTHKVZGPPA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.798027666 (601h8m56.6814413s) [noise=true , address=77.90.31.19:4842 , piece_id=C3PIB4BNPDUDFVCE7CUBBCJEJVXMST2HG5FRYN4GMKQNEGMKZQCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.801662815 (601h8m56.685076444s) [noise=true , address=104.36.82.15:4257 , piece_id=ZLRHK52WBIITKAN7XL3IXRUXARJZHG4MBYCNKQKAEDZM3LO4SZCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.807815370 (601h8m56.691229003s) [noise=true , address=104.36.82.13:4186 , piece_id=PKBR6JU3XOQDZVW2L6XSE3PBJCYNIHJFF7QAZGU5L32ATPCT2WQA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.816684873 (601h8m56.700098485s) [noise=true , address=104.36.82.2:4731 , piece_id=QL3J2KZ7JSL6XCT7BEBTICYDNO7J46BKMFWGVZGHFXHL4HJCJMCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.822376971 (601h8m56.705790598s) [noise=true , address=104.36.82.14:4222 , piece_id=UEDV5F73GO5VVWRS6OUFFU4DC5KH2E7J6ORUAS6ENH6X3JASIOSQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:20:25.646275878 (601h9m25.529689504s) [noise=true , address=77.90.31.11:4554 , piece_id=TMJCTAKQSBU43GAPDKFRO4CV25F3NUSXLRR3BHJYWGJHLAH6U2GA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646361211 (601h9m25.529774832s) [noise=true , address=77.90.31.13:4627 , piece_id=ET6E4UJJY4BED3BF6OMIR7M3FUUQI2HS6EXBETDW5VZ7A4TKY63A, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:40210->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646422784 (601h9m25.529836403s) [noise=true , address=77.90.31.17:4771 , piece_id=DTFPLMPZCBZAEXQQVIHFAXYDCPQLV7RTSLTG5LZ3R4JWW6VFOIFA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 139.59.144.22:54416->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646498682 (601h9m25.529912301s) [noise=true , address=77.90.31.16:4734 , piece_id=OZOFFS3ATHKYAQX5IF3N7ZLBFEIRPPCQKFWJBGPSSB4PL4ZKGYLA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:35464->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646512514 (601h9m25.529926133s) [noise=true , address=77.90.31.19:4843 , piece_id=35FVX7VL3RSJJSJYB6B63XDL7KBURU6LKWDE2EUOM4YHX477DQHA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: rpc: dial tcp 77.90.31.19:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646569038 (601h9m25.529982655s) [noise=true , address=77.90.31.10:4519 , piece_id=BGSDLEI6DGABQ6MPE6MKB3GQTSZFCLU2SMHXOYOTJAXIPOPPQUMA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646604894 (601h9m25.530018531s) [seg_pos={0 0}, upload=480662]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 18 10:20:25.770785641 (601h9m25.654199264s) [upload=480662]: Done uploading segments... Jul 18 10:20:25.770811727 (601h9m25.654225346s) [upload=480662]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.342126936s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.587454719s FAIL (2025-07-18 10:56:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.58748232s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.411434598s FAIL (2025-07-18 10:56:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 480650]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 10:18:47.533942446 (601h7m47.417356079s) [upload=480650]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 10:18:47.812231852 (601h7m47.695645478s) [upload=480650]: Done uploading segments... Jul 18 10:18:47.812262386 (601h7m47.695676006s) [upload=480650]: Upload finished. err: <nil> Jul 18 10:19:55.918921928 (601h8m55.802335557s) [upload=480662]: Starting upload Jul 18 10:19:55.919029214 (601h8m55.802442841s) [upload=480662]: Done starting upload Jul 18 10:19:55.919155429 (601h8m55.802569051s) [upload=480662]: Uploading segments... Jul 18 10:19:55.919515206 (601h8m55.802928835s) [upload=480662]: Got next segment. Inline: false Jul 18 10:19:55.919571748 (601h8m55.802985369s) [upload=480662]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:19:55.919578101 (601h8m55.802991727s) [upload=480662]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:19:56.031248080 (601h8m55.914661696s) [seg_pos={0 0}, upload=480662]: Begin upload segment... Jul 18 10:19:56.031292240 (601h8m55.914705855s) [seg_pos={0 0}, upload=480662]: Done begin upload segment. Jul 18 10:19:56.031317268 (601h8m55.914730898s) [noise=true , address=104.36.82.15:4257 , piece_id=ZLRHK52WBIITKAN7XL3IXRUXARJZHG4MBYCNKQKAEDZM3LO4SZCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031351551 (601h8m55.914765183s) [noise=true , address=77.90.31.11:4554 , piece_id=TMJCTAKQSBU43GAPDKFRO4CV25F3NUSXLRR3BHJYWGJHLAH6U2GA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031690493 (601h8m55.915104123s) [noise=true , address=104.36.82.2:4731 , piece_id=QL3J2KZ7JSL6XCT7BEBTICYDNO7J46BKMFWGVZGHFXHL4HJCJMCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031812851 (601h8m55.915226478s) [noise=true , address=77.90.31.10:4519 , piece_id=BGSDLEI6DGABQ6MPE6MKB3GQTSZFCLU2SMHXOYOTJAXIPOPPQUMA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.031989185 (601h8m55.915402815s) [noise=true , address=45.91.116.8:4048 , piece_id=CGRSYOZRYATMSMSUFQOJWVCRXSTH4XNIHOPLHB2SO3LKPA7VYHUA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032350596 (601h8m55.915764228s) [noise=true , address=104.36.82.14:4222 , piece_id=UEDV5F73GO5VVWRS6OUFFU4DC5KH2E7J6ORUAS6ENH6X3JASIOSQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032484269 (601h8m55.915897899s) [noise=true , address=77.90.31.13:4627 , piece_id=ET6E4UJJY4BED3BF6OMIR7M3FUUQI2HS6EXBETDW5VZ7A4TKY63A, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032667765 (601h8m55.916081392s) [noise=true , address=77.90.31.19:4842 , piece_id=C3PIB4BNPDUDFVCE7CUBBCJEJVXMST2HG5FRYN4GMKQNEGMKZQCQ, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032790153 (601h8m55.916203782s) [noise=true , address=77.90.31.17:4771 , piece_id=DTFPLMPZCBZAEXQQVIHFAXYDCPQLV7RTSLTG5LZ3R4JWW6VFOIFA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.032975878 (601h8m55.916389503s) [noise=true , address=77.90.31.19:4843 , piece_id=35FVX7VL3RSJJSJYB6B63XDL7KBURU6LKWDE2EUOM4YHX477DQHA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033092815 (601h8m55.916506452s) [noise=true , address=77.90.31.16:4734 , piece_id=OZOFFS3ATHKYAQX5IF3N7ZLBFEIRPPCQKFWJBGPSSB4PL4ZKGYLA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033265110 (601h8m55.916678735s) [noise=true , address=77.90.31.14:4662 , piece_id=PQEQRAMXQ6ISPUEGVC7H3QBW4RGELHSQRVGZ73ZN7S2MYIK4DK2Q, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033381530 (601h8m55.91679516s) [noise=true , address=45.91.116.11:4117 , piece_id=JQEYTY2QX7PEGBA2HB3S3YHBN6BLM7JJ7ZMRROC6RPTTHKVZGPPA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033556914 (601h8m55.91697054s) [noise=true , address=77.90.31.18:4806 , piece_id=NO4NHTDSAH4UUNLH4JF4WVJOVTH5YYN3MLXH6MJZLB5L7VPTN36A, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.033711089 (601h8m55.917124725s) [noise=true , address=45.91.116.6:4973 , piece_id=HP3EHZ7DTMK5NROFME4BB6L35GNHP4BUZ7GXMMMHNQNE5QIBQNRA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.034072226 (601h8m55.91748586s) [noise=true , address=104.36.82.13:4186 , piece_id=PKBR6JU3XOQDZVW2L6XSE3PBJCYNIHJFF7QAZGU5L32ATPCT2WQA, seg_pos={0 0}, upload=480662]: Uploading piece... Jul 18 10:19:56.636472896 (601h8m56.519886527s) [upload=480662]: Next returned nil segment Jul 18 10:19:56.636496664 (601h8m56.51991028s) [upload=480662]: Waiting for error group managing segments... Jul 18 10:19:56.771748829 (601h8m56.655162461s) [noise=true , address=77.90.31.18:4806 , piece_id=NO4NHTDSAH4UUNLH4JF4WVJOVTH5YYN3MLXH6MJZLB5L7VPTN36A, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.774291101 (601h8m56.657704713s) [noise=true , address=77.90.31.14:4662 , piece_id=PQEQRAMXQ6ISPUEGVC7H3QBW4RGELHSQRVGZ73ZN7S2MYIK4DK2Q, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.777786273 (601h8m56.661199903s) [noise=true , address=45.91.116.6:4973 , piece_id=HP3EHZ7DTMK5NROFME4BB6L35GNHP4BUZ7GXMMMHNQNE5QIBQNRA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.792902845 (601h8m56.676316463s) [noise=true , address=45.91.116.8:4048 , piece_id=CGRSYOZRYATMSMSUFQOJWVCRXSTH4XNIHOPLHB2SO3LKPA7VYHUA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.793108817 (601h8m56.676522435s) [noise=true , address=45.91.116.11:4117 , piece_id=JQEYTY2QX7PEGBA2HB3S3YHBN6BLM7JJ7ZMRROC6RPTTHKVZGPPA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.798027666 (601h8m56.6814413s) [noise=true , address=77.90.31.19:4842 , piece_id=C3PIB4BNPDUDFVCE7CUBBCJEJVXMST2HG5FRYN4GMKQNEGMKZQCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.801662815 (601h8m56.685076444s) [noise=true , address=104.36.82.15:4257 , piece_id=ZLRHK52WBIITKAN7XL3IXRUXARJZHG4MBYCNKQKAEDZM3LO4SZCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.807815370 (601h8m56.691229003s) [noise=true , address=104.36.82.13:4186 , piece_id=PKBR6JU3XOQDZVW2L6XSE3PBJCYNIHJFF7QAZGU5L32ATPCT2WQA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.816684873 (601h8m56.700098485s) [noise=true , address=104.36.82.2:4731 , piece_id=QL3J2KZ7JSL6XCT7BEBTICYDNO7J46BKMFWGVZGHFXHL4HJCJMCQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:19:56.822376971 (601h8m56.705790598s) [noise=true , address=104.36.82.14:4222 , piece_id=UEDV5F73GO5VVWRS6OUFFU4DC5KH2E7J6ORUAS6ENH6X3JASIOSQ, seg_pos={0 0}, upload=480662]: Done uploading piece. err: <nil> Jul 18 10:20:25.646275878 (601h9m25.529689504s) [noise=true , address=77.90.31.11:4554 , piece_id=TMJCTAKQSBU43GAPDKFRO4CV25F3NUSXLRR3BHJYWGJHLAH6U2GA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646361211 (601h9m25.529774832s) [noise=true , address=77.90.31.13:4627 , piece_id=ET6E4UJJY4BED3BF6OMIR7M3FUUQI2HS6EXBETDW5VZ7A4TKY63A, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:40210->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646422784 (601h9m25.529836403s) [noise=true , address=77.90.31.17:4771 , piece_id=DTFPLMPZCBZAEXQQVIHFAXYDCPQLV7RTSLTG5LZ3R4JWW6VFOIFA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 139.59.144.22:54416->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646498682 (601h9m25.529912301s) [noise=true , address=77.90.31.16:4734 , piece_id=OZOFFS3ATHKYAQX5IF3N7ZLBFEIRPPCQKFWJBGPSSB4PL4ZKGYLA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:35464->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646512514 (601h9m25.529926133s) [noise=true , address=77.90.31.19:4843 , piece_id=35FVX7VL3RSJJSJYB6B63XDL7KBURU6LKWDE2EUOM4YHX477DQHA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: rpc: dial tcp 77.90.31.19:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646569038 (601h9m25.529982655s) [noise=true , address=77.90.31.10:4519 , piece_id=BGSDLEI6DGABQ6MPE6MKB3GQTSZFCLU2SMHXOYOTJAXIPOPPQUMA, seg_pos={0 0}, upload=480662]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:20:25.646604894 (601h9m25.530018531s) [seg_pos={0 0}, upload=480662]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 18 10:20:25.770785641 (601h9m25.654199264s) [upload=480662]: Done uploading segments... Jul 18 10:20:25.770811727 (601h9m25.654225346s) [upload=480662]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.411466794s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.440542628s FAIL (2025-07-18 10:56:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.440585784s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.611861965s FAIL (2025-07-18 10:56:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.61189474s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.427208024s FAIL (2025-07-18 10:55:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.427273027s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)