Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 2.723633699s FAIL (2025-07-15 00:06:10 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout Duration: 2.723715569s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.134478089s FAIL (2025-07-15 00:05:58 UTC) orbiter warning: ======ERROR====== uplink: too many requests ======LOGS====== . Jul 14 23:47:30.334396460 (518h36m30.217810097s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334541002 (518h36m30.217954628s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334751321 (518h36m30.218164948s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335060864 (518h36m30.218474493s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335335126 (518h36m30.218748752s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.336922859 (518h36m30.220336495s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.340514312 (518h36m30.223927967s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.342052396 (518h36m30.225466052s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.485954867 (518h36m30.369368503s) [upload=414748]: Next returned nil segment Jul 14 23:47:30.485992786 (518h36m30.369406532s) [upload=414748]: Waiting for error group managing segments... Jul 14 23:47:30.494842357 (518h36m30.378255988s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.494930968 (518h36m30.378344595s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496014314 (518h36m30.379427941s) [noise=true , address=89.149.201.147:4023 , piece_id=NQLJ6UGQTXWMNJ2XJSVQ2JPD2INWQNUPPQVHBYO6HPX6XX6HMWFA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496680756 (518h36m30.380094372s) [noise=true , address=89.149.201.147:4006 , piece_id=JDGIM3TFHCOR7DT2EW4DHR4KKMYTBNJXEQQKI2YVB3OFIRXAMETA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496801905 (518h36m30.380215532s) [noise=true , address=89.149.201.147:4019 , piece_id=3DMKAPD3M2A25PEKEWOOJCHV6CWKDUOZCZNPYDTQYBNSAML3MHCQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497347115 (518h36m30.380760731s) [noise=true , address=89.149.201.147:4010 , piece_id=WCL5DLELLH7HWRF4NVXPG66W3PABG5LCQ7EI5QCHNGYL3WP26WSA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497557301 (518h36m30.380970929s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498036118 (518h36m30.381449734s) [noise=true , address=89.149.201.147:4016 , piece_id=ZMUHQFGECGG6MKG7UWO4NWYOABOD6VYQ27JQNHSWGBCNY6RQOUCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498203330 (518h36m30.381616957s) [noise=true , address=185.167.204.205:4020 , piece_id=AF6L62IEU6KD2JIX7BL4VSIK6T7OCPETILSYGVGNS3MKX3XWTWKQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498564222 (518h36m30.381977836s) [noise=true , address=185.167.204.205:4023 , piece_id=B7OGRML6TDBWHQW7H5WZISNAEZLUTC4NUU6YJXLJG76ODSTTR2XA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498778308 (518h36m30.382191936s) [noise=true , address=81.171.14.70:4047 , piece_id=B2B7YV32YDVUG2L4Q6KV5FP63D6LIIVXEVWQEVQPLLO64NIWVK7A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499060384 (518h36m30.382473998s) [noise=true , address=89.149.201.147:4017 , piece_id=OIUOJWKUHESMRGC2BHH45FNETDVKUMQTZHJICDYUDZCI66HS24EA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499773462 (518h36m30.383187089s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500485883 (518h36m30.383899502s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500637044 (518h36m30.384050662s) [noise=true , address=89.149.201.147:4024 , piece_id=R6CF74YBNZ5NZHPCCBTUZ3PGHY56SAILYSNXV5L7FV37VORHXLZA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500973891 (518h36m30.384387517s) [noise=true , address=81.171.14.70:4035 , piece_id=WMRQULXAT3UTOHK42S2ILFR7T7PICZUWCDRTMNOPCK2MKEZMI5LA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.501397526 (518h36m30.384811139s) [noise=true , address=89.149.201.147:4012 , piece_id=26IJ6NKKCUGV35XKHM4TISEX2CIWG3DNIHWYOHOMVMU4ANTCX6RA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502337750 (518h36m30.385751362s) [noise=true , address=81.171.14.70:4030 , piece_id=FYBIQ4RINS5VAJS4VJKIJIREPWAZPESYAKSBKSZEX6OWXELKHJ3A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502702474 (518h36m30.386116088s) [noise=true , address=81.171.14.70:4039 , piece_id=E4Q4U6JPWVZOWPDJI6A6AO7WQ72D2GOPMZQSYOHCWOOZVVE6NIKA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503020550 (518h36m30.386434163s) [noise=true , address=81.171.14.70:4044 , piece_id=3XFKCWS4CN6C73YU54KJNACXZDBZUKBMSASVLAFGKOF5SGGB2UUA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503356663 (518h36m30.386770277s) [noise=true , address=81.171.14.70:4031 , piece_id=GLUVAUI4ZVFE2C6OCNNRS3GVAFBJ6WG3ALYTNEBRSL6QBXA5B4LQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.504974620 (518h36m30.388388232s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505290772 (518h36m30.388704384s) [noise=true , address=185.167.204.205:4027 , piece_id=4T7OLFAAULHVCZO7IOTX4CAJRA5J4ALHNB23B2SXPCSILECYTG6A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505629943 (518h36m30.389043556s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505933309 (518h36m30.389346921s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507266987 (518h36m30.390680601s) [noise=true , address=89.149.201.147:4015 , piece_id=NPDGCLM2ZF64ZBOAPL2VT2XR4QMTFNZC3I43VVXLMGPCVER3F45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507293406 (518h36m30.390707035s) [seg_pos={0 0}, upload=414748]: Segment reached optimal threshold of 26 pieces. Jul 14 23:47:30.507519964 (518h36m30.390933597s) [noise=true , address=81.171.14.70:4042 , piece_id=ASRUL4I2SLJEFFJLR6KBMGIAY3THJPR67YGCHBIMYNUFJKFRP2GA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507609664 (518h36m30.391023293s) [noise=true , address=81.171.14.70:4029 , piece_id=LYKFSQWETSW6OJPHJYVD3LLP44S7RABUIBRHI5LMZSP2JJLDQIHQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507634788 (518h36m30.391048419s) [seg_pos={0 0}, upload=414748]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Jul 14 23:47:30.507717732 (518h36m30.391131358s) [upload=414748]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 23:47:30.507724547 (518h36m30.391138177s) [upload=414748]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:47:30.547070340 (518h36m30.430483976s) [upload=414748]: Done uploading segments... Jul 14 23:47:30.547094478 (518h36m30.430508105s) [upload=414748]: Upload finished. err: <nil> Jul 14 23:47:30.863955222 (518h36m30.747368849s) [upload=414749]: Starting upload Jul 14 23:47:30.864023814 (518h36m30.747437456s) [upload=414749]: Done starting upload Jul 14 23:47:30.864126584 (518h36m30.747540202s) [upload=414749]: Uploading segments... Jul 14 23:47:30.864360135 (518h36m30.747773761s) [upload=414749]: Got next segment. Inline: false Jul 14 23:47:30.864426077 (518h36m30.747839704s) [upload=414749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:47:30.864431154 (518h36m30.747844779s) [upload=414749]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 23:47:30.867084429 (518h36m30.750498058s) [upload=414749]: Next segment err: metaclient: Too Many Requests Jul 14 23:47:30.867113197 (518h36m30.750526824s) [upload=414749]: Done uploading segments... Jul 14 23:47:30.867126113 (518h36m30.750539725s) [upload=414749]: Upload finished. err: metaclient: Too Many Requests Duration: 1.134535899s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.461034956s FAIL (2025-07-15 00:05:48 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.461065362s core uplink us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 4 out of 60 is failed (threshold=3) [.......................X..........XX........X...............] duration: 10.188203ms target: https://eu1.storj.io/login FAIL (2025-07-15 00:05:47 UTC) Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:57607->127.0.0.1:53: i/o timeout Duration: 10.212081ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 903.482782ms FAIL (2025-07-15 00:05:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 14 23:37:41.147633909 (518h26m41.031047542s) [upload=414628]: Done starting upload Jul 14 23:37:41.147700406 (518h26m41.031114026s) [upload=414628]: Uploading segments... Jul 14 23:37:41.147749349 (518h26m41.031162964s) [upload=414628]: Got next segment. Inline: true Jul 14 23:37:41.147757931 (518h26m41.031171548s) [upload=414628]: Waiting for error group managing segments... Jul 14 23:37:41.147803445 (518h26m41.031217064s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:37:41.147810713 (518h26m41.031224329s) [upload=414628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:37:41.147814220 (518h26m41.031227838s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:37:41.293868983 (518h26m41.177282609s) [upload=414628]: Done uploading segments... Jul 14 23:37:41.293899619 (518h26m41.177313246s) [upload=414628]: Upload finished. err: <nil> Jul 14 23:38:42.060547925 (518h27m41.943961552s) [upload=414641]: Starting upload Jul 14 23:38:42.060706705 (518h27m41.94412033s) [upload=414641]: Done starting upload Jul 14 23:38:42.060775681 (518h27m41.9441893s) [upload=414641]: Uploading segments... Jul 14 23:38:42.060850917 (518h27m41.944264562s) [upload=414641]: Got next segment. Inline: true Jul 14 23:38:42.060857684 (518h27m41.944271318s) [upload=414641]: Waiting for error group managing segments... Jul 14 23:38:42.060905522 (518h27m41.944319139s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:38:42.060911671 (518h27m41.944325297s) [upload=414641]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:38:42.060915517 (518h27m41.944329143s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:38:42.214653360 (518h27m42.098066984s) [upload=414641]: Done uploading segments... Jul 14 23:38:42.214672288 (518h27m42.098085904s) [upload=414641]: Upload finished. err: <nil> Jul 14 23:39:37.897497561 (518h28m37.780911178s) [upload=414653]: Starting upload Jul 14 23:39:37.897653216 (518h28m37.781066839s) [upload=414653]: Done starting upload Jul 14 23:39:37.897770536 (518h28m37.781184151s) [upload=414653]: Uploading segments... Jul 14 23:39:37.897826735 (518h28m37.781240362s) [upload=414653]: Got next segment. Inline: true Jul 14 23:39:37.897832545 (518h28m37.78124616s) [upload=414653]: Waiting for error group managing segments... Jul 14 23:39:37.897874540 (518h28m37.781288156s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:39:37.897880498 (518h28m37.781294125s) [upload=414653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:39:37.897884204 (518h28m37.78129783s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:39:38.174501392 (518h28m38.057915021s) [upload=414653]: Done uploading segments... Jul 14 23:39:38.174554097 (518h28m38.057967728s) [upload=414653]: Upload finished. err: <nil> Jul 14 23:40:47.713120393 (518h29m47.596534011s) [upload=414666]: Starting upload Jul 14 23:40:47.713181294 (518h29m47.596594929s) [upload=414666]: Done starting upload Jul 14 23:40:47.713333461 (518h29m47.596747074s) [upload=414666]: Uploading segments... Jul 14 23:40:47.713419846 (518h29m47.596833481s) [upload=414666]: Got next segment. Inline: true Jul 14 23:40:47.713427208 (518h29m47.596840876s) [upload=414666]: Waiting for error group managing segments... Jul 14 23:40:47.713492271 (518h29m47.596905915s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:40:47.713499814 (518h29m47.596913451s) [upload=414666]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:40:47.713503937 (518h29m47.596917586s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:40:47.868352520 (518h29m47.751766137s) [upload=414666]: Done uploading segments... Jul 14 23:40:47.868375465 (518h29m47.751789083s) [upload=414666]: Upload finished. err: <nil> Jul 14 23:41:00.797063324 (518h30m0.680476953s) [upload=414670]: Starting upload Jul 14 23:41:00.797141064 (518h30m0.68055469s) [upload=414670]: Done starting upload Jul 14 23:41:00.797212895 (518h30m0.680626511s) [upload=414670]: Uploading segments... Jul 14 23:41:00.797265690 (518h30m0.680679326s) [upload=414670]: Got next segment. Inline: true Jul 14 23:41:00.797270956 (518h30m0.680684572s) [upload=414670]: Waiting for error group managing segments... Jul 14 23:41:00.797328313 (518h30m0.680741939s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:00.797333853 (518h30m0.680747469s) [upload=414670]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:00.797337094 (518h30m0.68075072s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:00.971853045 (518h30m0.855266664s) [upload=414670]: Done uploading segments... Jul 14 23:41:00.971870916 (518h30m0.855284535s) [upload=414670]: Upload finished. err: <nil> Jul 14 23:41:22.318635815 (518h30m22.202049441s) [upload=414675]: Starting upload Jul 14 23:41:22.318697752 (518h30m22.202111381s) [upload=414675]: Done starting upload Jul 14 23:41:22.318755348 (518h30m22.20216896s) [upload=414675]: Uploading segments... Jul 14 23:41:22.318804414 (518h30m22.202218058s) [upload=414675]: Got next segment. Inline: true Jul 14 23:41:22.318812150 (518h30m22.202225763s) [upload=414675]: Waiting for error group managing segments... Jul 14 23:41:22.318860496 (518h30m22.202274126s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:22.318868059 (518h30m22.202281687s) [upload=414675]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:22.318872383 (518h30m22.202286008s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:22.468688511 (518h30m22.352102153s) [upload=414675]: Done uploading segments... Jul 14 23:41:22.468726173 (518h30m22.352139798s) [upload=414675]: Upload finished. err: <nil> Jul 14 23:42:39.877715214 (518h31m39.761128848s) [upload=414689]: Starting upload Jul 14 23:42:39.877790693 (518h31m39.76120433s) [upload=414689]: Done starting upload Jul 14 23:42:39.877900973 (518h31m39.761314587s) [upload=414689]: Uploading segments... Jul 14 23:42:39.878016572 (518h31m39.761430206s) [upload=414689]: Got next segment. Inline: true Jul 14 23:42:39.878023247 (518h31m39.761436881s) [upload=414689]: Waiting for error group managing segments... Jul 14 23:42:39.878073628 (518h31m39.761487264s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:39.878079532 (518h31m39.761493165s) [upload=414689]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:39.878083359 (518h31m39.761496973s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:40.027578980 (518h31m39.910992594s) [upload=414689]: Done uploading segments... Jul 14 23:42:40.027596526 (518h31m39.911010138s) [upload=414689]: Upload finished. err: <nil> Jul 14 23:42:40.961643522 (518h31m40.845057134s) [upload=414691]: Starting upload Jul 14 23:42:40.961719043 (518h31m40.845132672s) [upload=414691]: Done starting upload Jul 14 23:42:40.961792548 (518h31m40.84520616s) [upload=414691]: Uploading segments... Jul 14 23:42:40.961837433 (518h31m40.845251071s) [upload=414691]: Got next segment. Inline: true Jul 14 23:42:40.961851857 (518h31m40.845265486s) [upload=414691]: Waiting for error group managing segments... Jul 14 23:42:40.961890425 (518h31m40.845304037s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:40.961896055 (518h31m40.845309668s) [upload=414691]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:40.961898536 (518h31m40.845312147s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:41.122451811 (518h31m41.005865429s) [upload=414691]: Done uploading segments... Jul 14 23:42:41.122493314 (518h31m41.005906934s) [upload=414691]: Upload finished. err: <nil> Jul 14 23:43:34.049461829 (518h32m33.932875453s) [upload=414704]: Starting upload Jul 14 23:43:34.049588567 (518h32m33.933002206s) [upload=414704]: Done starting upload Jul 14 23:43:34.049735609 (518h32m33.933149224s) [upload=414704]: Uploading segments... Jul 14 23:43:34.049802945 (518h32m33.933216575s) [upload=414704]: Got next segment. Inline: true Jul 14 23:43:34.049810415 (518h32m33.933224046s) [upload=414704]: Waiting for error group managing segments... Jul 14 23:43:34.049877223 (518h32m33.93329084s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:34.049883389 (518h32m33.933297014s) [upload=414704]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:34.049887164 (518h32m33.933300789s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:34.197832086 (518h32m34.081245712s) [upload=414704]: Done uploading segments... Jul 14 23:43:34.197864776 (518h32m34.08127839s) [upload=414704]: Upload finished. err: <nil> Jul 14 23:43:56.290942463 (518h32m56.174356083s) [upload=414709]: Starting upload Jul 14 23:43:56.291049037 (518h32m56.174462655s) [upload=414709]: Done starting upload Jul 14 23:43:56.291143970 (518h32m56.174557592s) [upload=414709]: Uploading segments... Jul 14 23:43:56.291226174 (518h32m56.174639809s) [upload=414709]: Got next segment. Inline: true Jul 14 23:43:56.291231359 (518h32m56.174644972s) [upload=414709]: Waiting for error group managing segments... Jul 14 23:43:56.291289737 (518h32m56.17470335s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:56.291295711 (518h32m56.174709323s) [upload=414709]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:56.291298840 (518h32m56.174712452s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:56.428766698 (518h32m56.312180324s) [upload=414709]: Done uploading segments... Jul 14 23:43:56.428788768 (518h32m56.312202386s) [upload=414709]: Upload finished. err: <nil> Duration: 903.526128ms core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 519.443048ms target: https://ap1.storj.io/login FAIL (2025-07-15 00:05:45 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:60425->127.0.0.1:53: i/o timeout Duration: 519.480383ms core satellite ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 114.362801ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-07-15 00:05:41 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:57172->127.0.0.1:53: i/o timeout Duration: 114.389198ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X........X..........................] duration: 1.269973633s FAIL (2025-07-15 00:05:39 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.270076313s core uplink eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 177.709254ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-15 00:05:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:47171->127.0.0.1:53: i/o timeout Duration: 177.815206ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 826.637886ms FAIL (2025-07-15 00:05:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 14 23:37:41.147633909 (518h26m41.031047542s) [upload=414628]: Done starting upload Jul 14 23:37:41.147700406 (518h26m41.031114026s) [upload=414628]: Uploading segments... Jul 14 23:37:41.147749349 (518h26m41.031162964s) [upload=414628]: Got next segment. Inline: true Jul 14 23:37:41.147757931 (518h26m41.031171548s) [upload=414628]: Waiting for error group managing segments... Jul 14 23:37:41.147803445 (518h26m41.031217064s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:37:41.147810713 (518h26m41.031224329s) [upload=414628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:37:41.147814220 (518h26m41.031227838s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:37:41.293868983 (518h26m41.177282609s) [upload=414628]: Done uploading segments... Jul 14 23:37:41.293899619 (518h26m41.177313246s) [upload=414628]: Upload finished. err: <nil> Jul 14 23:38:42.060547925 (518h27m41.943961552s) [upload=414641]: Starting upload Jul 14 23:38:42.060706705 (518h27m41.94412033s) [upload=414641]: Done starting upload Jul 14 23:38:42.060775681 (518h27m41.9441893s) [upload=414641]: Uploading segments... Jul 14 23:38:42.060850917 (518h27m41.944264562s) [upload=414641]: Got next segment. Inline: true Jul 14 23:38:42.060857684 (518h27m41.944271318s) [upload=414641]: Waiting for error group managing segments... Jul 14 23:38:42.060905522 (518h27m41.944319139s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:38:42.060911671 (518h27m41.944325297s) [upload=414641]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:38:42.060915517 (518h27m41.944329143s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:38:42.214653360 (518h27m42.098066984s) [upload=414641]: Done uploading segments... Jul 14 23:38:42.214672288 (518h27m42.098085904s) [upload=414641]: Upload finished. err: <nil> Jul 14 23:39:37.897497561 (518h28m37.780911178s) [upload=414653]: Starting upload Jul 14 23:39:37.897653216 (518h28m37.781066839s) [upload=414653]: Done starting upload Jul 14 23:39:37.897770536 (518h28m37.781184151s) [upload=414653]: Uploading segments... Jul 14 23:39:37.897826735 (518h28m37.781240362s) [upload=414653]: Got next segment. Inline: true Jul 14 23:39:37.897832545 (518h28m37.78124616s) [upload=414653]: Waiting for error group managing segments... Jul 14 23:39:37.897874540 (518h28m37.781288156s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:39:37.897880498 (518h28m37.781294125s) [upload=414653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:39:37.897884204 (518h28m37.78129783s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:39:38.174501392 (518h28m38.057915021s) [upload=414653]: Done uploading segments... Jul 14 23:39:38.174554097 (518h28m38.057967728s) [upload=414653]: Upload finished. err: <nil> Jul 14 23:40:47.713120393 (518h29m47.596534011s) [upload=414666]: Starting upload Jul 14 23:40:47.713181294 (518h29m47.596594929s) [upload=414666]: Done starting upload Jul 14 23:40:47.713333461 (518h29m47.596747074s) [upload=414666]: Uploading segments... Jul 14 23:40:47.713419846 (518h29m47.596833481s) [upload=414666]: Got next segment. Inline: true Jul 14 23:40:47.713427208 (518h29m47.596840876s) [upload=414666]: Waiting for error group managing segments... Jul 14 23:40:47.713492271 (518h29m47.596905915s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:40:47.713499814 (518h29m47.596913451s) [upload=414666]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:40:47.713503937 (518h29m47.596917586s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:40:47.868352520 (518h29m47.751766137s) [upload=414666]: Done uploading segments... Jul 14 23:40:47.868375465 (518h29m47.751789083s) [upload=414666]: Upload finished. err: <nil> Jul 14 23:41:00.797063324 (518h30m0.680476953s) [upload=414670]: Starting upload Jul 14 23:41:00.797141064 (518h30m0.68055469s) [upload=414670]: Done starting upload Jul 14 23:41:00.797212895 (518h30m0.680626511s) [upload=414670]: Uploading segments... Jul 14 23:41:00.797265690 (518h30m0.680679326s) [upload=414670]: Got next segment. Inline: true Jul 14 23:41:00.797270956 (518h30m0.680684572s) [upload=414670]: Waiting for error group managing segments... Jul 14 23:41:00.797328313 (518h30m0.680741939s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:00.797333853 (518h30m0.680747469s) [upload=414670]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:00.797337094 (518h30m0.68075072s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:00.971853045 (518h30m0.855266664s) [upload=414670]: Done uploading segments... Jul 14 23:41:00.971870916 (518h30m0.855284535s) [upload=414670]: Upload finished. err: <nil> Jul 14 23:41:22.318635815 (518h30m22.202049441s) [upload=414675]: Starting upload Jul 14 23:41:22.318697752 (518h30m22.202111381s) [upload=414675]: Done starting upload Jul 14 23:41:22.318755348 (518h30m22.20216896s) [upload=414675]: Uploading segments... Jul 14 23:41:22.318804414 (518h30m22.202218058s) [upload=414675]: Got next segment. Inline: true Jul 14 23:41:22.318812150 (518h30m22.202225763s) [upload=414675]: Waiting for error group managing segments... Jul 14 23:41:22.318860496 (518h30m22.202274126s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:22.318868059 (518h30m22.202281687s) [upload=414675]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:22.318872383 (518h30m22.202286008s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:22.468688511 (518h30m22.352102153s) [upload=414675]: Done uploading segments... Jul 14 23:41:22.468726173 (518h30m22.352139798s) [upload=414675]: Upload finished. err: <nil> Jul 14 23:42:39.877715214 (518h31m39.761128848s) [upload=414689]: Starting upload Jul 14 23:42:39.877790693 (518h31m39.76120433s) [upload=414689]: Done starting upload Jul 14 23:42:39.877900973 (518h31m39.761314587s) [upload=414689]: Uploading segments... Jul 14 23:42:39.878016572 (518h31m39.761430206s) [upload=414689]: Got next segment. Inline: true Jul 14 23:42:39.878023247 (518h31m39.761436881s) [upload=414689]: Waiting for error group managing segments... Jul 14 23:42:39.878073628 (518h31m39.761487264s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:39.878079532 (518h31m39.761493165s) [upload=414689]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:39.878083359 (518h31m39.761496973s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:40.027578980 (518h31m39.910992594s) [upload=414689]: Done uploading segments... Jul 14 23:42:40.027596526 (518h31m39.911010138s) [upload=414689]: Upload finished. err: <nil> Jul 14 23:42:40.961643522 (518h31m40.845057134s) [upload=414691]: Starting upload Jul 14 23:42:40.961719043 (518h31m40.845132672s) [upload=414691]: Done starting upload Jul 14 23:42:40.961792548 (518h31m40.84520616s) [upload=414691]: Uploading segments... Jul 14 23:42:40.961837433 (518h31m40.845251071s) [upload=414691]: Got next segment. Inline: true Jul 14 23:42:40.961851857 (518h31m40.845265486s) [upload=414691]: Waiting for error group managing segments... Jul 14 23:42:40.961890425 (518h31m40.845304037s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:40.961896055 (518h31m40.845309668s) [upload=414691]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:40.961898536 (518h31m40.845312147s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:41.122451811 (518h31m41.005865429s) [upload=414691]: Done uploading segments... Jul 14 23:42:41.122493314 (518h31m41.005906934s) [upload=414691]: Upload finished. err: <nil> Jul 14 23:43:34.049461829 (518h32m33.932875453s) [upload=414704]: Starting upload Jul 14 23:43:34.049588567 (518h32m33.933002206s) [upload=414704]: Done starting upload Jul 14 23:43:34.049735609 (518h32m33.933149224s) [upload=414704]: Uploading segments... Jul 14 23:43:34.049802945 (518h32m33.933216575s) [upload=414704]: Got next segment. Inline: true Jul 14 23:43:34.049810415 (518h32m33.933224046s) [upload=414704]: Waiting for error group managing segments... Jul 14 23:43:34.049877223 (518h32m33.93329084s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:34.049883389 (518h32m33.933297014s) [upload=414704]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:34.049887164 (518h32m33.933300789s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:34.197832086 (518h32m34.081245712s) [upload=414704]: Done uploading segments... Jul 14 23:43:34.197864776 (518h32m34.08127839s) [upload=414704]: Upload finished. err: <nil> Jul 14 23:43:56.290942463 (518h32m56.174356083s) [upload=414709]: Starting upload Jul 14 23:43:56.291049037 (518h32m56.174462655s) [upload=414709]: Done starting upload Jul 14 23:43:56.291143970 (518h32m56.174557592s) [upload=414709]: Uploading segments... Jul 14 23:43:56.291226174 (518h32m56.174639809s) [upload=414709]: Got next segment. Inline: true Jul 14 23:43:56.291231359 (518h32m56.174644972s) [upload=414709]: Waiting for error group managing segments... Jul 14 23:43:56.291289737 (518h32m56.17470335s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:56.291295711 (518h32m56.174709323s) [upload=414709]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:56.291298840 (518h32m56.174712452s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:56.428766698 (518h32m56.312180324s) [upload=414709]: Done uploading segments... Jul 14 23:43:56.428788768 (518h32m56.312202386s) [upload=414709]: Upload finished. err: <nil> Duration: 826.678054ms core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.056064534s FAIL (2025-07-15 00:05:29 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:54371->127.0.0.1:53: i/o timeout Duration: 1.05612564s edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.642914477s FAIL (2025-07-15 00:05:23 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.642949758s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X........X.........................] duration: 1.414143344s FAIL (2025-07-15 00:05:22 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.414174021s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [X.................................X.........................] duration: 523.111308ms target: https://ap1.storj.io/login FAIL (2025-07-15 00:05:21 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:60425->127.0.0.1:53: i/o timeout Duration: 523.140221ms core satellite ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 42.02731ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-07-15 00:05:15 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41928->127.0.0.1:53: i/o timeout Duration: 42.058879ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 3.21114355s FAIL (2025-07-15 00:05:10 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout Duration: 3.211173054s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.....................X..................................XX..] duration: 299.155183ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-15 00:05:09 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:49745->127.0.0.1:53: i/o timeout Duration: 299.195984ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 286.359447ms target: https://us1.storj.io/login FAIL (2025-07-15 00:05:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:55697->127.0.0.1:53: i/o timeout Duration: 286.405125ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 268.552418ms FAIL (2025-07-15 00:05:02 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 268.59085ms core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 889.836852ms FAIL (2025-07-15 00:05:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 14 23:37:41.147633909 (518h26m41.031047542s) [upload=414628]: Done starting upload Jul 14 23:37:41.147700406 (518h26m41.031114026s) [upload=414628]: Uploading segments... Jul 14 23:37:41.147749349 (518h26m41.031162964s) [upload=414628]: Got next segment. Inline: true Jul 14 23:37:41.147757931 (518h26m41.031171548s) [upload=414628]: Waiting for error group managing segments... Jul 14 23:37:41.147803445 (518h26m41.031217064s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:37:41.147810713 (518h26m41.031224329s) [upload=414628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:37:41.147814220 (518h26m41.031227838s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:37:41.293868983 (518h26m41.177282609s) [upload=414628]: Done uploading segments... Jul 14 23:37:41.293899619 (518h26m41.177313246s) [upload=414628]: Upload finished. err: <nil> Jul 14 23:38:42.060547925 (518h27m41.943961552s) [upload=414641]: Starting upload Jul 14 23:38:42.060706705 (518h27m41.94412033s) [upload=414641]: Done starting upload Jul 14 23:38:42.060775681 (518h27m41.9441893s) [upload=414641]: Uploading segments... Jul 14 23:38:42.060850917 (518h27m41.944264562s) [upload=414641]: Got next segment. Inline: true Jul 14 23:38:42.060857684 (518h27m41.944271318s) [upload=414641]: Waiting for error group managing segments... Jul 14 23:38:42.060905522 (518h27m41.944319139s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:38:42.060911671 (518h27m41.944325297s) [upload=414641]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:38:42.060915517 (518h27m41.944329143s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:38:42.214653360 (518h27m42.098066984s) [upload=414641]: Done uploading segments... Jul 14 23:38:42.214672288 (518h27m42.098085904s) [upload=414641]: Upload finished. err: <nil> Jul 14 23:39:37.897497561 (518h28m37.780911178s) [upload=414653]: Starting upload Jul 14 23:39:37.897653216 (518h28m37.781066839s) [upload=414653]: Done starting upload Jul 14 23:39:37.897770536 (518h28m37.781184151s) [upload=414653]: Uploading segments... Jul 14 23:39:37.897826735 (518h28m37.781240362s) [upload=414653]: Got next segment. Inline: true Jul 14 23:39:37.897832545 (518h28m37.78124616s) [upload=414653]: Waiting for error group managing segments... Jul 14 23:39:37.897874540 (518h28m37.781288156s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:39:37.897880498 (518h28m37.781294125s) [upload=414653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:39:37.897884204 (518h28m37.78129783s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:39:38.174501392 (518h28m38.057915021s) [upload=414653]: Done uploading segments... Jul 14 23:39:38.174554097 (518h28m38.057967728s) [upload=414653]: Upload finished. err: <nil> Jul 14 23:40:47.713120393 (518h29m47.596534011s) [upload=414666]: Starting upload Jul 14 23:40:47.713181294 (518h29m47.596594929s) [upload=414666]: Done starting upload Jul 14 23:40:47.713333461 (518h29m47.596747074s) [upload=414666]: Uploading segments... Jul 14 23:40:47.713419846 (518h29m47.596833481s) [upload=414666]: Got next segment. Inline: true Jul 14 23:40:47.713427208 (518h29m47.596840876s) [upload=414666]: Waiting for error group managing segments... Jul 14 23:40:47.713492271 (518h29m47.596905915s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:40:47.713499814 (518h29m47.596913451s) [upload=414666]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:40:47.713503937 (518h29m47.596917586s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:40:47.868352520 (518h29m47.751766137s) [upload=414666]: Done uploading segments... Jul 14 23:40:47.868375465 (518h29m47.751789083s) [upload=414666]: Upload finished. err: <nil> Jul 14 23:41:00.797063324 (518h30m0.680476953s) [upload=414670]: Starting upload Jul 14 23:41:00.797141064 (518h30m0.68055469s) [upload=414670]: Done starting upload Jul 14 23:41:00.797212895 (518h30m0.680626511s) [upload=414670]: Uploading segments... Jul 14 23:41:00.797265690 (518h30m0.680679326s) [upload=414670]: Got next segment. Inline: true Jul 14 23:41:00.797270956 (518h30m0.680684572s) [upload=414670]: Waiting for error group managing segments... Jul 14 23:41:00.797328313 (518h30m0.680741939s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:00.797333853 (518h30m0.680747469s) [upload=414670]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:00.797337094 (518h30m0.68075072s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:00.971853045 (518h30m0.855266664s) [upload=414670]: Done uploading segments... Jul 14 23:41:00.971870916 (518h30m0.855284535s) [upload=414670]: Upload finished. err: <nil> Jul 14 23:41:22.318635815 (518h30m22.202049441s) [upload=414675]: Starting upload Jul 14 23:41:22.318697752 (518h30m22.202111381s) [upload=414675]: Done starting upload Jul 14 23:41:22.318755348 (518h30m22.20216896s) [upload=414675]: Uploading segments... Jul 14 23:41:22.318804414 (518h30m22.202218058s) [upload=414675]: Got next segment. Inline: true Jul 14 23:41:22.318812150 (518h30m22.202225763s) [upload=414675]: Waiting for error group managing segments... Jul 14 23:41:22.318860496 (518h30m22.202274126s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:22.318868059 (518h30m22.202281687s) [upload=414675]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:22.318872383 (518h30m22.202286008s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:22.468688511 (518h30m22.352102153s) [upload=414675]: Done uploading segments... Jul 14 23:41:22.468726173 (518h30m22.352139798s) [upload=414675]: Upload finished. err: <nil> Jul 14 23:42:39.877715214 (518h31m39.761128848s) [upload=414689]: Starting upload Jul 14 23:42:39.877790693 (518h31m39.76120433s) [upload=414689]: Done starting upload Jul 14 23:42:39.877900973 (518h31m39.761314587s) [upload=414689]: Uploading segments... Jul 14 23:42:39.878016572 (518h31m39.761430206s) [upload=414689]: Got next segment. Inline: true Jul 14 23:42:39.878023247 (518h31m39.761436881s) [upload=414689]: Waiting for error group managing segments... Jul 14 23:42:39.878073628 (518h31m39.761487264s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:39.878079532 (518h31m39.761493165s) [upload=414689]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:39.878083359 (518h31m39.761496973s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:40.027578980 (518h31m39.910992594s) [upload=414689]: Done uploading segments... Jul 14 23:42:40.027596526 (518h31m39.911010138s) [upload=414689]: Upload finished. err: <nil> Jul 14 23:42:40.961643522 (518h31m40.845057134s) [upload=414691]: Starting upload Jul 14 23:42:40.961719043 (518h31m40.845132672s) [upload=414691]: Done starting upload Jul 14 23:42:40.961792548 (518h31m40.84520616s) [upload=414691]: Uploading segments... Jul 14 23:42:40.961837433 (518h31m40.845251071s) [upload=414691]: Got next segment. Inline: true Jul 14 23:42:40.961851857 (518h31m40.845265486s) [upload=414691]: Waiting for error group managing segments... Jul 14 23:42:40.961890425 (518h31m40.845304037s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:40.961896055 (518h31m40.845309668s) [upload=414691]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:40.961898536 (518h31m40.845312147s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:41.122451811 (518h31m41.005865429s) [upload=414691]: Done uploading segments... Jul 14 23:42:41.122493314 (518h31m41.005906934s) [upload=414691]: Upload finished. err: <nil> Jul 14 23:43:34.049461829 (518h32m33.932875453s) [upload=414704]: Starting upload Jul 14 23:43:34.049588567 (518h32m33.933002206s) [upload=414704]: Done starting upload Jul 14 23:43:34.049735609 (518h32m33.933149224s) [upload=414704]: Uploading segments... Jul 14 23:43:34.049802945 (518h32m33.933216575s) [upload=414704]: Got next segment. Inline: true Jul 14 23:43:34.049810415 (518h32m33.933224046s) [upload=414704]: Waiting for error group managing segments... Jul 14 23:43:34.049877223 (518h32m33.93329084s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:34.049883389 (518h32m33.933297014s) [upload=414704]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:34.049887164 (518h32m33.933300789s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:34.197832086 (518h32m34.081245712s) [upload=414704]: Done uploading segments... Jul 14 23:43:34.197864776 (518h32m34.08127839s) [upload=414704]: Upload finished. err: <nil> Jul 14 23:43:56.290942463 (518h32m56.174356083s) [upload=414709]: Starting upload Jul 14 23:43:56.291049037 (518h32m56.174462655s) [upload=414709]: Done starting upload Jul 14 23:43:56.291143970 (518h32m56.174557592s) [upload=414709]: Uploading segments... Jul 14 23:43:56.291226174 (518h32m56.174639809s) [upload=414709]: Got next segment. Inline: true Jul 14 23:43:56.291231359 (518h32m56.174644972s) [upload=414709]: Waiting for error group managing segments... Jul 14 23:43:56.291289737 (518h32m56.17470335s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:56.291295711 (518h32m56.174709323s) [upload=414709]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:56.291298840 (518h32m56.174712452s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:56.428766698 (518h32m56.312180324s) [upload=414709]: Done uploading segments... Jul 14 23:43:56.428788768 (518h32m56.312202386s) [upload=414709]: Upload finished. err: <nil> Duration: 889.869772ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 120.053552ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-07-15 00:04:57 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:57172->127.0.0.1:53: i/o timeout Duration: 120.087102ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 444.395964ms FAIL (2025-07-15 00:04:53 UTC) orbiter warning: ======ERROR====== uplink: too many requests ======LOGS====== . Jul 14 23:47:30.334396460 (518h36m30.217810097s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334541002 (518h36m30.217954628s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334751321 (518h36m30.218164948s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335060864 (518h36m30.218474493s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335335126 (518h36m30.218748752s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.336922859 (518h36m30.220336495s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.340514312 (518h36m30.223927967s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.342052396 (518h36m30.225466052s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.485954867 (518h36m30.369368503s) [upload=414748]: Next returned nil segment Jul 14 23:47:30.485992786 (518h36m30.369406532s) [upload=414748]: Waiting for error group managing segments... Jul 14 23:47:30.494842357 (518h36m30.378255988s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.494930968 (518h36m30.378344595s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496014314 (518h36m30.379427941s) [noise=true , address=89.149.201.147:4023 , piece_id=NQLJ6UGQTXWMNJ2XJSVQ2JPD2INWQNUPPQVHBYO6HPX6XX6HMWFA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496680756 (518h36m30.380094372s) [noise=true , address=89.149.201.147:4006 , piece_id=JDGIM3TFHCOR7DT2EW4DHR4KKMYTBNJXEQQKI2YVB3OFIRXAMETA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496801905 (518h36m30.380215532s) [noise=true , address=89.149.201.147:4019 , piece_id=3DMKAPD3M2A25PEKEWOOJCHV6CWKDUOZCZNPYDTQYBNSAML3MHCQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497347115 (518h36m30.380760731s) [noise=true , address=89.149.201.147:4010 , piece_id=WCL5DLELLH7HWRF4NVXPG66W3PABG5LCQ7EI5QCHNGYL3WP26WSA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497557301 (518h36m30.380970929s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498036118 (518h36m30.381449734s) [noise=true , address=89.149.201.147:4016 , piece_id=ZMUHQFGECGG6MKG7UWO4NWYOABOD6VYQ27JQNHSWGBCNY6RQOUCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498203330 (518h36m30.381616957s) [noise=true , address=185.167.204.205:4020 , piece_id=AF6L62IEU6KD2JIX7BL4VSIK6T7OCPETILSYGVGNS3MKX3XWTWKQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498564222 (518h36m30.381977836s) [noise=true , address=185.167.204.205:4023 , piece_id=B7OGRML6TDBWHQW7H5WZISNAEZLUTC4NUU6YJXLJG76ODSTTR2XA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498778308 (518h36m30.382191936s) [noise=true , address=81.171.14.70:4047 , piece_id=B2B7YV32YDVUG2L4Q6KV5FP63D6LIIVXEVWQEVQPLLO64NIWVK7A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499060384 (518h36m30.382473998s) [noise=true , address=89.149.201.147:4017 , piece_id=OIUOJWKUHESMRGC2BHH45FNETDVKUMQTZHJICDYUDZCI66HS24EA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499773462 (518h36m30.383187089s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500485883 (518h36m30.383899502s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500637044 (518h36m30.384050662s) [noise=true , address=89.149.201.147:4024 , piece_id=R6CF74YBNZ5NZHPCCBTUZ3PGHY56SAILYSNXV5L7FV37VORHXLZA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500973891 (518h36m30.384387517s) [noise=true , address=81.171.14.70:4035 , piece_id=WMRQULXAT3UTOHK42S2ILFR7T7PICZUWCDRTMNOPCK2MKEZMI5LA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.501397526 (518h36m30.384811139s) [noise=true , address=89.149.201.147:4012 , piece_id=26IJ6NKKCUGV35XKHM4TISEX2CIWG3DNIHWYOHOMVMU4ANTCX6RA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502337750 (518h36m30.385751362s) [noise=true , address=81.171.14.70:4030 , piece_id=FYBIQ4RINS5VAJS4VJKIJIREPWAZPESYAKSBKSZEX6OWXELKHJ3A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502702474 (518h36m30.386116088s) [noise=true , address=81.171.14.70:4039 , piece_id=E4Q4U6JPWVZOWPDJI6A6AO7WQ72D2GOPMZQSYOHCWOOZVVE6NIKA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503020550 (518h36m30.386434163s) [noise=true , address=81.171.14.70:4044 , piece_id=3XFKCWS4CN6C73YU54KJNACXZDBZUKBMSASVLAFGKOF5SGGB2UUA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503356663 (518h36m30.386770277s) [noise=true , address=81.171.14.70:4031 , piece_id=GLUVAUI4ZVFE2C6OCNNRS3GVAFBJ6WG3ALYTNEBRSL6QBXA5B4LQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.504974620 (518h36m30.388388232s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505290772 (518h36m30.388704384s) [noise=true , address=185.167.204.205:4027 , piece_id=4T7OLFAAULHVCZO7IOTX4CAJRA5J4ALHNB23B2SXPCSILECYTG6A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505629943 (518h36m30.389043556s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505933309 (518h36m30.389346921s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507266987 (518h36m30.390680601s) [noise=true , address=89.149.201.147:4015 , piece_id=NPDGCLM2ZF64ZBOAPL2VT2XR4QMTFNZC3I43VVXLMGPCVER3F45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507293406 (518h36m30.390707035s) [seg_pos={0 0}, upload=414748]: Segment reached optimal threshold of 26 pieces. Jul 14 23:47:30.507519964 (518h36m30.390933597s) [noise=true , address=81.171.14.70:4042 , piece_id=ASRUL4I2SLJEFFJLR6KBMGIAY3THJPR67YGCHBIMYNUFJKFRP2GA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507609664 (518h36m30.391023293s) [noise=true , address=81.171.14.70:4029 , piece_id=LYKFSQWETSW6OJPHJYVD3LLP44S7RABUIBRHI5LMZSP2JJLDQIHQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507634788 (518h36m30.391048419s) [seg_pos={0 0}, upload=414748]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Jul 14 23:47:30.507717732 (518h36m30.391131358s) [upload=414748]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 23:47:30.507724547 (518h36m30.391138177s) [upload=414748]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:47:30.547070340 (518h36m30.430483976s) [upload=414748]: Done uploading segments... Jul 14 23:47:30.547094478 (518h36m30.430508105s) [upload=414748]: Upload finished. err: <nil> Jul 14 23:47:30.863955222 (518h36m30.747368849s) [upload=414749]: Starting upload Jul 14 23:47:30.864023814 (518h36m30.747437456s) [upload=414749]: Done starting upload Jul 14 23:47:30.864126584 (518h36m30.747540202s) [upload=414749]: Uploading segments... Jul 14 23:47:30.864360135 (518h36m30.747773761s) [upload=414749]: Got next segment. Inline: false Jul 14 23:47:30.864426077 (518h36m30.747839704s) [upload=414749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:47:30.864431154 (518h36m30.747844779s) [upload=414749]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 23:47:30.867084429 (518h36m30.750498058s) [upload=414749]: Next segment err: metaclient: Too Many Requests Jul 14 23:47:30.867113197 (518h36m30.750526824s) [upload=414749]: Done uploading segments... Jul 14 23:47:30.867126113 (518h36m30.750539725s) [upload=414749]: Upload finished. err: metaclient: Too Many Requests Duration: 444.489345ms core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 4 out of 60 is failed (threshold=3) [........................X..........XX........X..............] duration: 11.692269ms target: https://eu1.storj.io/login FAIL (2025-07-15 00:04:52 UTC) Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:57607->127.0.0.1:53: i/o timeout Duration: 11.713717ms core satellite eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [......................X..................................XX.] duration: 410.570811ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-15 00:04:48 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:49745->127.0.0.1:53: i/o timeout Duration: 410.598979ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 274.883813ms target: https://us1.storj.io/login FAIL (2025-07-15 00:04:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:55697->127.0.0.1:53: i/o timeout Duration: 274.926682ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.189549772s FAIL (2025-07-15 00:04:42 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.189579551s core uplink us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 542.994541ms FAIL (2025-07-15 00:04:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:54371->127.0.0.1:53: i/o timeout Duration: 543.030505ms edge authservice http bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 510.302915ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-15 00:04:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:47171->127.0.0.1:53: i/o timeout Duration: 510.328279ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.X.................................X........................] duration: 515.045798ms target: https://ap1.storj.io/login FAIL (2025-07-15 00:04:31 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:60425->127.0.0.1:53: i/o timeout Duration: 515.082401ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 515.833872ms FAIL (2025-07-15 00:04:29 UTC) orbiter warning: ======ERROR====== uplink: too many requests ======LOGS====== . Jul 14 23:47:30.334396460 (518h36m30.217810097s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334541002 (518h36m30.217954628s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334751321 (518h36m30.218164948s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335060864 (518h36m30.218474493s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335335126 (518h36m30.218748752s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.336922859 (518h36m30.220336495s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.340514312 (518h36m30.223927967s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.342052396 (518h36m30.225466052s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.485954867 (518h36m30.369368503s) [upload=414748]: Next returned nil segment Jul 14 23:47:30.485992786 (518h36m30.369406532s) [upload=414748]: Waiting for error group managing segments... Jul 14 23:47:30.494842357 (518h36m30.378255988s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.494930968 (518h36m30.378344595s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496014314 (518h36m30.379427941s) [noise=true , address=89.149.201.147:4023 , piece_id=NQLJ6UGQTXWMNJ2XJSVQ2JPD2INWQNUPPQVHBYO6HPX6XX6HMWFA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496680756 (518h36m30.380094372s) [noise=true , address=89.149.201.147:4006 , piece_id=JDGIM3TFHCOR7DT2EW4DHR4KKMYTBNJXEQQKI2YVB3OFIRXAMETA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496801905 (518h36m30.380215532s) [noise=true , address=89.149.201.147:4019 , piece_id=3DMKAPD3M2A25PEKEWOOJCHV6CWKDUOZCZNPYDTQYBNSAML3MHCQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497347115 (518h36m30.380760731s) [noise=true , address=89.149.201.147:4010 , piece_id=WCL5DLELLH7HWRF4NVXPG66W3PABG5LCQ7EI5QCHNGYL3WP26WSA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497557301 (518h36m30.380970929s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498036118 (518h36m30.381449734s) [noise=true , address=89.149.201.147:4016 , piece_id=ZMUHQFGECGG6MKG7UWO4NWYOABOD6VYQ27JQNHSWGBCNY6RQOUCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498203330 (518h36m30.381616957s) [noise=true , address=185.167.204.205:4020 , piece_id=AF6L62IEU6KD2JIX7BL4VSIK6T7OCPETILSYGVGNS3MKX3XWTWKQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498564222 (518h36m30.381977836s) [noise=true , address=185.167.204.205:4023 , piece_id=B7OGRML6TDBWHQW7H5WZISNAEZLUTC4NUU6YJXLJG76ODSTTR2XA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498778308 (518h36m30.382191936s) [noise=true , address=81.171.14.70:4047 , piece_id=B2B7YV32YDVUG2L4Q6KV5FP63D6LIIVXEVWQEVQPLLO64NIWVK7A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499060384 (518h36m30.382473998s) [noise=true , address=89.149.201.147:4017 , piece_id=OIUOJWKUHESMRGC2BHH45FNETDVKUMQTZHJICDYUDZCI66HS24EA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499773462 (518h36m30.383187089s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500485883 (518h36m30.383899502s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500637044 (518h36m30.384050662s) [noise=true , address=89.149.201.147:4024 , piece_id=R6CF74YBNZ5NZHPCCBTUZ3PGHY56SAILYSNXV5L7FV37VORHXLZA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500973891 (518h36m30.384387517s) [noise=true , address=81.171.14.70:4035 , piece_id=WMRQULXAT3UTOHK42S2ILFR7T7PICZUWCDRTMNOPCK2MKEZMI5LA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.501397526 (518h36m30.384811139s) [noise=true , address=89.149.201.147:4012 , piece_id=26IJ6NKKCUGV35XKHM4TISEX2CIWG3DNIHWYOHOMVMU4ANTCX6RA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502337750 (518h36m30.385751362s) [noise=true , address=81.171.14.70:4030 , piece_id=FYBIQ4RINS5VAJS4VJKIJIREPWAZPESYAKSBKSZEX6OWXELKHJ3A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502702474 (518h36m30.386116088s) [noise=true , address=81.171.14.70:4039 , piece_id=E4Q4U6JPWVZOWPDJI6A6AO7WQ72D2GOPMZQSYOHCWOOZVVE6NIKA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503020550 (518h36m30.386434163s) [noise=true , address=81.171.14.70:4044 , piece_id=3XFKCWS4CN6C73YU54KJNACXZDBZUKBMSASVLAFGKOF5SGGB2UUA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503356663 (518h36m30.386770277s) [noise=true , address=81.171.14.70:4031 , piece_id=GLUVAUI4ZVFE2C6OCNNRS3GVAFBJ6WG3ALYTNEBRSL6QBXA5B4LQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.504974620 (518h36m30.388388232s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505290772 (518h36m30.388704384s) [noise=true , address=185.167.204.205:4027 , piece_id=4T7OLFAAULHVCZO7IOTX4CAJRA5J4ALHNB23B2SXPCSILECYTG6A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505629943 (518h36m30.389043556s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505933309 (518h36m30.389346921s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507266987 (518h36m30.390680601s) [noise=true , address=89.149.201.147:4015 , piece_id=NPDGCLM2ZF64ZBOAPL2VT2XR4QMTFNZC3I43VVXLMGPCVER3F45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507293406 (518h36m30.390707035s) [seg_pos={0 0}, upload=414748]: Segment reached optimal threshold of 26 pieces. Jul 14 23:47:30.507519964 (518h36m30.390933597s) [noise=true , address=81.171.14.70:4042 , piece_id=ASRUL4I2SLJEFFJLR6KBMGIAY3THJPR67YGCHBIMYNUFJKFRP2GA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507609664 (518h36m30.391023293s) [noise=true , address=81.171.14.70:4029 , piece_id=LYKFSQWETSW6OJPHJYVD3LLP44S7RABUIBRHI5LMZSP2JJLDQIHQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507634788 (518h36m30.391048419s) [seg_pos={0 0}, upload=414748]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Jul 14 23:47:30.507717732 (518h36m30.391131358s) [upload=414748]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 23:47:30.507724547 (518h36m30.391138177s) [upload=414748]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:47:30.547070340 (518h36m30.430483976s) [upload=414748]: Done uploading segments... Jul 14 23:47:30.547094478 (518h36m30.430508105s) [upload=414748]: Upload finished. err: <nil> Jul 14 23:47:30.863955222 (518h36m30.747368849s) [upload=414749]: Starting upload Jul 14 23:47:30.864023814 (518h36m30.747437456s) [upload=414749]: Done starting upload Jul 14 23:47:30.864126584 (518h36m30.747540202s) [upload=414749]: Uploading segments... Jul 14 23:47:30.864360135 (518h36m30.747773761s) [upload=414749]: Got next segment. Inline: false Jul 14 23:47:30.864426077 (518h36m30.747839704s) [upload=414749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:47:30.864431154 (518h36m30.747844779s) [upload=414749]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 23:47:30.867084429 (518h36m30.750498058s) [upload=414749]: Next segment err: metaclient: Too Many Requests Jul 14 23:47:30.867113197 (518h36m30.750526824s) [upload=414749]: Done uploading segments... Jul 14 23:47:30.867126113 (518h36m30.750539725s) [upload=414749]: Upload finished. err: metaclient: Too Many Requests Duration: 515.888588ms core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..................................XX] duration: 10.012669971s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-15 00:04:29 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:49745->127.0.0.1:53: i/o timeout Duration: 10.012707991s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 37.665498ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-07-15 00:04:29 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41928->127.0.0.1:53: i/o timeout Duration: 37.69598ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 2.968206989s FAIL (2025-07-15 00:04:27 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout Duration: 2.968230118s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 271.527889ms target: https://us1.storj.io/login FAIL (2025-07-15 00:04:16 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:55697->127.0.0.1:53: i/o timeout Duration: 271.549676ms core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X........X........................] duration: 1.23260239s FAIL (2025-07-15 00:04:13 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.232639658s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 4 out of 60 is failed (threshold=3) [.........................X..........XX........X.............] duration: 11.240856ms target: https://eu1.storj.io/login FAIL (2025-07-15 00:04:08 UTC) Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:57607->127.0.0.1:53: i/o timeout Duration: 11.271041ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 848.578528ms FAIL (2025-07-15 00:04:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 14 23:37:41.147633909 (518h26m41.031047542s) [upload=414628]: Done starting upload Jul 14 23:37:41.147700406 (518h26m41.031114026s) [upload=414628]: Uploading segments... Jul 14 23:37:41.147749349 (518h26m41.031162964s) [upload=414628]: Got next segment. Inline: true Jul 14 23:37:41.147757931 (518h26m41.031171548s) [upload=414628]: Waiting for error group managing segments... Jul 14 23:37:41.147803445 (518h26m41.031217064s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:37:41.147810713 (518h26m41.031224329s) [upload=414628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:37:41.147814220 (518h26m41.031227838s) [upload=414628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:37:41.293868983 (518h26m41.177282609s) [upload=414628]: Done uploading segments... Jul 14 23:37:41.293899619 (518h26m41.177313246s) [upload=414628]: Upload finished. err: <nil> Jul 14 23:38:42.060547925 (518h27m41.943961552s) [upload=414641]: Starting upload Jul 14 23:38:42.060706705 (518h27m41.94412033s) [upload=414641]: Done starting upload Jul 14 23:38:42.060775681 (518h27m41.9441893s) [upload=414641]: Uploading segments... Jul 14 23:38:42.060850917 (518h27m41.944264562s) [upload=414641]: Got next segment. Inline: true Jul 14 23:38:42.060857684 (518h27m41.944271318s) [upload=414641]: Waiting for error group managing segments... Jul 14 23:38:42.060905522 (518h27m41.944319139s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:38:42.060911671 (518h27m41.944325297s) [upload=414641]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:38:42.060915517 (518h27m41.944329143s) [upload=414641]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:38:42.214653360 (518h27m42.098066984s) [upload=414641]: Done uploading segments... Jul 14 23:38:42.214672288 (518h27m42.098085904s) [upload=414641]: Upload finished. err: <nil> Jul 14 23:39:37.897497561 (518h28m37.780911178s) [upload=414653]: Starting upload Jul 14 23:39:37.897653216 (518h28m37.781066839s) [upload=414653]: Done starting upload Jul 14 23:39:37.897770536 (518h28m37.781184151s) [upload=414653]: Uploading segments... Jul 14 23:39:37.897826735 (518h28m37.781240362s) [upload=414653]: Got next segment. Inline: true Jul 14 23:39:37.897832545 (518h28m37.78124616s) [upload=414653]: Waiting for error group managing segments... Jul 14 23:39:37.897874540 (518h28m37.781288156s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:39:37.897880498 (518h28m37.781294125s) [upload=414653]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:39:37.897884204 (518h28m37.78129783s) [upload=414653]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:39:38.174501392 (518h28m38.057915021s) [upload=414653]: Done uploading segments... Jul 14 23:39:38.174554097 (518h28m38.057967728s) [upload=414653]: Upload finished. err: <nil> Jul 14 23:40:47.713120393 (518h29m47.596534011s) [upload=414666]: Starting upload Jul 14 23:40:47.713181294 (518h29m47.596594929s) [upload=414666]: Done starting upload Jul 14 23:40:47.713333461 (518h29m47.596747074s) [upload=414666]: Uploading segments... Jul 14 23:40:47.713419846 (518h29m47.596833481s) [upload=414666]: Got next segment. Inline: true Jul 14 23:40:47.713427208 (518h29m47.596840876s) [upload=414666]: Waiting for error group managing segments... Jul 14 23:40:47.713492271 (518h29m47.596905915s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:40:47.713499814 (518h29m47.596913451s) [upload=414666]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:40:47.713503937 (518h29m47.596917586s) [upload=414666]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:40:47.868352520 (518h29m47.751766137s) [upload=414666]: Done uploading segments... Jul 14 23:40:47.868375465 (518h29m47.751789083s) [upload=414666]: Upload finished. err: <nil> Jul 14 23:41:00.797063324 (518h30m0.680476953s) [upload=414670]: Starting upload Jul 14 23:41:00.797141064 (518h30m0.68055469s) [upload=414670]: Done starting upload Jul 14 23:41:00.797212895 (518h30m0.680626511s) [upload=414670]: Uploading segments... Jul 14 23:41:00.797265690 (518h30m0.680679326s) [upload=414670]: Got next segment. Inline: true Jul 14 23:41:00.797270956 (518h30m0.680684572s) [upload=414670]: Waiting for error group managing segments... Jul 14 23:41:00.797328313 (518h30m0.680741939s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:00.797333853 (518h30m0.680747469s) [upload=414670]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:00.797337094 (518h30m0.68075072s) [upload=414670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:00.971853045 (518h30m0.855266664s) [upload=414670]: Done uploading segments... Jul 14 23:41:00.971870916 (518h30m0.855284535s) [upload=414670]: Upload finished. err: <nil> Jul 14 23:41:22.318635815 (518h30m22.202049441s) [upload=414675]: Starting upload Jul 14 23:41:22.318697752 (518h30m22.202111381s) [upload=414675]: Done starting upload Jul 14 23:41:22.318755348 (518h30m22.20216896s) [upload=414675]: Uploading segments... Jul 14 23:41:22.318804414 (518h30m22.202218058s) [upload=414675]: Got next segment. Inline: true Jul 14 23:41:22.318812150 (518h30m22.202225763s) [upload=414675]: Waiting for error group managing segments... Jul 14 23:41:22.318860496 (518h30m22.202274126s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:41:22.318868059 (518h30m22.202281687s) [upload=414675]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:41:22.318872383 (518h30m22.202286008s) [upload=414675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:41:22.468688511 (518h30m22.352102153s) [upload=414675]: Done uploading segments... Jul 14 23:41:22.468726173 (518h30m22.352139798s) [upload=414675]: Upload finished. err: <nil> Jul 14 23:42:39.877715214 (518h31m39.761128848s) [upload=414689]: Starting upload Jul 14 23:42:39.877790693 (518h31m39.76120433s) [upload=414689]: Done starting upload Jul 14 23:42:39.877900973 (518h31m39.761314587s) [upload=414689]: Uploading segments... Jul 14 23:42:39.878016572 (518h31m39.761430206s) [upload=414689]: Got next segment. Inline: true Jul 14 23:42:39.878023247 (518h31m39.761436881s) [upload=414689]: Waiting for error group managing segments... Jul 14 23:42:39.878073628 (518h31m39.761487264s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:39.878079532 (518h31m39.761493165s) [upload=414689]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:39.878083359 (518h31m39.761496973s) [upload=414689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:40.027578980 (518h31m39.910992594s) [upload=414689]: Done uploading segments... Jul 14 23:42:40.027596526 (518h31m39.911010138s) [upload=414689]: Upload finished. err: <nil> Jul 14 23:42:40.961643522 (518h31m40.845057134s) [upload=414691]: Starting upload Jul 14 23:42:40.961719043 (518h31m40.845132672s) [upload=414691]: Done starting upload Jul 14 23:42:40.961792548 (518h31m40.84520616s) [upload=414691]: Uploading segments... Jul 14 23:42:40.961837433 (518h31m40.845251071s) [upload=414691]: Got next segment. Inline: true Jul 14 23:42:40.961851857 (518h31m40.845265486s) [upload=414691]: Waiting for error group managing segments... Jul 14 23:42:40.961890425 (518h31m40.845304037s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:42:40.961896055 (518h31m40.845309668s) [upload=414691]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:42:40.961898536 (518h31m40.845312147s) [upload=414691]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:42:41.122451811 (518h31m41.005865429s) [upload=414691]: Done uploading segments... Jul 14 23:42:41.122493314 (518h31m41.005906934s) [upload=414691]: Upload finished. err: <nil> Jul 14 23:43:34.049461829 (518h32m33.932875453s) [upload=414704]: Starting upload Jul 14 23:43:34.049588567 (518h32m33.933002206s) [upload=414704]: Done starting upload Jul 14 23:43:34.049735609 (518h32m33.933149224s) [upload=414704]: Uploading segments... Jul 14 23:43:34.049802945 (518h32m33.933216575s) [upload=414704]: Got next segment. Inline: true Jul 14 23:43:34.049810415 (518h32m33.933224046s) [upload=414704]: Waiting for error group managing segments... Jul 14 23:43:34.049877223 (518h32m33.93329084s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:34.049883389 (518h32m33.933297014s) [upload=414704]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:34.049887164 (518h32m33.933300789s) [upload=414704]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:34.197832086 (518h32m34.081245712s) [upload=414704]: Done uploading segments... Jul 14 23:43:34.197864776 (518h32m34.08127839s) [upload=414704]: Upload finished. err: <nil> Jul 14 23:43:56.290942463 (518h32m56.174356083s) [upload=414709]: Starting upload Jul 14 23:43:56.291049037 (518h32m56.174462655s) [upload=414709]: Done starting upload Jul 14 23:43:56.291143970 (518h32m56.174557592s) [upload=414709]: Uploading segments... Jul 14 23:43:56.291226174 (518h32m56.174639809s) [upload=414709]: Got next segment. Inline: true Jul 14 23:43:56.291231359 (518h32m56.174644972s) [upload=414709]: Waiting for error group managing segments... Jul 14 23:43:56.291289737 (518h32m56.17470335s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:43:56.291295711 (518h32m56.174709323s) [upload=414709]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 23:43:56.291298840 (518h32m56.174712452s) [upload=414709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:43:56.428766698 (518h32m56.312180324s) [upload=414709]: Done uploading segments... Jul 14 23:43:56.428788768 (518h32m56.312202386s) [upload=414709]: Upload finished. err: <nil> Duration: 848.622861ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 36.397314ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-07-15 00:04:06 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41928->127.0.0.1:53: i/o timeout Duration: 36.432911ms edge gateway vhost bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 552.308201ms FAIL (2025-07-15 00:04:04 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:54371->127.0.0.1:53: i/o timeout Duration: 552.349792ms edge authservice http bgp us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 617.992565ms target: https://us1.storj.io/login FAIL (2025-07-15 00:03:57 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:55697->127.0.0.1:53: i/o timeout Duration: 618.019938ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.234222958s FAIL (2025-07-15 00:03:54 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.234271031s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 110.243056ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-07-15 00:03:54 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:57172->127.0.0.1:53: i/o timeout Duration: 110.345536ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [........................X..................................X] duration: 10.002123885s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-15 00:03:53 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:36007->127.0.0.1:53: i/o timeout Duration: 10.002220036s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 257.148708ms FAIL (2025-07-15 00:03:49 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 257.18401ms core uplink eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 181.789023ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-15 00:03:48 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:47171->127.0.0.1:53: i/o timeout Duration: 181.812811ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 460.216463ms FAIL (2025-07-15 00:03:46 UTC) orbiter warning: ======ERROR====== uplink: too many requests ======LOGS====== . Jul 14 23:47:30.334396460 (518h36m30.217810097s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334541002 (518h36m30.217954628s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.334751321 (518h36m30.218164948s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335060864 (518h36m30.218474493s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.335335126 (518h36m30.218748752s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.336922859 (518h36m30.220336495s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.340514312 (518h36m30.223927967s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.342052396 (518h36m30.225466052s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Uploading piece... Jul 14 23:47:30.485954867 (518h36m30.369368503s) [upload=414748]: Next returned nil segment Jul 14 23:47:30.485992786 (518h36m30.369406532s) [upload=414748]: Waiting for error group managing segments... Jul 14 23:47:30.494842357 (518h36m30.378255988s) [noise=true , address=89.149.201.147:4005 , piece_id=DRCMTHMTAA3GDMFIOJX2SHSFA3TL7KC2U3CJ3NNUEQQXGCW5PGSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.494930968 (518h36m30.378344595s) [noise=true , address=89.149.201.147:4022 , piece_id=7ZS6QYRU5CQZZ3KHH3TVBLGWT6G4HFVGUDEDYTXQ6DWYIQAISMLQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496014314 (518h36m30.379427941s) [noise=true , address=89.149.201.147:4023 , piece_id=NQLJ6UGQTXWMNJ2XJSVQ2JPD2INWQNUPPQVHBYO6HPX6XX6HMWFA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496680756 (518h36m30.380094372s) [noise=true , address=89.149.201.147:4006 , piece_id=JDGIM3TFHCOR7DT2EW4DHR4KKMYTBNJXEQQKI2YVB3OFIRXAMETA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.496801905 (518h36m30.380215532s) [noise=true , address=89.149.201.147:4019 , piece_id=3DMKAPD3M2A25PEKEWOOJCHV6CWKDUOZCZNPYDTQYBNSAML3MHCQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497347115 (518h36m30.380760731s) [noise=true , address=89.149.201.147:4010 , piece_id=WCL5DLELLH7HWRF4NVXPG66W3PABG5LCQ7EI5QCHNGYL3WP26WSA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.497557301 (518h36m30.380970929s) [noise=true , address=81.171.14.70:4027 , piece_id=UFITELK6U7CJ5MO6DK46KMDBADRXL4X3ITLBBGPDIKONOIU2ZV6Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498036118 (518h36m30.381449734s) [noise=true , address=89.149.201.147:4016 , piece_id=ZMUHQFGECGG6MKG7UWO4NWYOABOD6VYQ27JQNHSWGBCNY6RQOUCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498203330 (518h36m30.381616957s) [noise=true , address=185.167.204.205:4020 , piece_id=AF6L62IEU6KD2JIX7BL4VSIK6T7OCPETILSYGVGNS3MKX3XWTWKQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498564222 (518h36m30.381977836s) [noise=true , address=185.167.204.205:4023 , piece_id=B7OGRML6TDBWHQW7H5WZISNAEZLUTC4NUU6YJXLJG76ODSTTR2XA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.498778308 (518h36m30.382191936s) [noise=true , address=81.171.14.70:4047 , piece_id=B2B7YV32YDVUG2L4Q6KV5FP63D6LIIVXEVWQEVQPLLO64NIWVK7A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499060384 (518h36m30.382473998s) [noise=true , address=89.149.201.147:4017 , piece_id=OIUOJWKUHESMRGC2BHH45FNETDVKUMQTZHJICDYUDZCI66HS24EA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.499773462 (518h36m30.383187089s) [noise=true , address=185.167.204.206:4056 , piece_id=VYVMHTMO2RWAXNUCUZRMEUH4ONO67QDRV4F5M57BGNX35LYXB45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500485883 (518h36m30.383899502s) [noise=true , address=81.171.14.70:4033 , piece_id=D4AOU75QAT7HSFOS3CCHDE5MPT4W6DCX5FZD4HFKFRVL3ZNWQMSQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500637044 (518h36m30.384050662s) [noise=true , address=89.149.201.147:4024 , piece_id=R6CF74YBNZ5NZHPCCBTUZ3PGHY56SAILYSNXV5L7FV37VORHXLZA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.500973891 (518h36m30.384387517s) [noise=true , address=81.171.14.70:4035 , piece_id=WMRQULXAT3UTOHK42S2ILFR7T7PICZUWCDRTMNOPCK2MKEZMI5LA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.501397526 (518h36m30.384811139s) [noise=true , address=89.149.201.147:4012 , piece_id=26IJ6NKKCUGV35XKHM4TISEX2CIWG3DNIHWYOHOMVMU4ANTCX6RA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502337750 (518h36m30.385751362s) [noise=true , address=81.171.14.70:4030 , piece_id=FYBIQ4RINS5VAJS4VJKIJIREPWAZPESYAKSBKSZEX6OWXELKHJ3A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.502702474 (518h36m30.386116088s) [noise=true , address=81.171.14.70:4039 , piece_id=E4Q4U6JPWVZOWPDJI6A6AO7WQ72D2GOPMZQSYOHCWOOZVVE6NIKA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503020550 (518h36m30.386434163s) [noise=true , address=81.171.14.70:4044 , piece_id=3XFKCWS4CN6C73YU54KJNACXZDBZUKBMSASVLAFGKOF5SGGB2UUA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.503356663 (518h36m30.386770277s) [noise=true , address=81.171.14.70:4031 , piece_id=GLUVAUI4ZVFE2C6OCNNRS3GVAFBJ6WG3ALYTNEBRSL6QBXA5B4LQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.504974620 (518h36m30.388388232s) [noise=true , address=185.167.204.206:4060 , piece_id=IJQZL4K3DLVPFO456GG4WUGUOPKCHMZRQ42RDWGBKYC5XEQU7Y3Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505290772 (518h36m30.388704384s) [noise=true , address=185.167.204.205:4027 , piece_id=4T7OLFAAULHVCZO7IOTX4CAJRA5J4ALHNB23B2SXPCSILECYTG6A, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505629943 (518h36m30.389043556s) [noise=true , address=185.167.204.205:4035 , piece_id=NGLYETXCGUBW4B6TUTQFZXSRADNS2XPDMIU2SQXDAKHUHOT6XHDA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.505933309 (518h36m30.389346921s) [noise=true , address=185.167.204.205:4036 , piece_id=BHX33VXHOFYBWTEXGC6PP2VODAWV4PUD5E2VH3FKS7Z3RXTRFJCA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507266987 (518h36m30.390680601s) [noise=true , address=89.149.201.147:4015 , piece_id=NPDGCLM2ZF64ZBOAPL2VT2XR4QMTFNZC3I43VVXLMGPCVER3F45Q, seg_pos={0 0}, upload=414748]: Done uploading piece. err: <nil> Jul 14 23:47:30.507293406 (518h36m30.390707035s) [seg_pos={0 0}, upload=414748]: Segment reached optimal threshold of 26 pieces. Jul 14 23:47:30.507519964 (518h36m30.390933597s) [noise=true , address=81.171.14.70:4042 , piece_id=ASRUL4I2SLJEFFJLR6KBMGIAY3THJPR67YGCHBIMYNUFJKFRP2GA, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507609664 (518h36m30.391023293s) [noise=true , address=81.171.14.70:4029 , piece_id=LYKFSQWETSW6OJPHJYVD3LLP44S7RABUIBRHI5LMZSP2JJLDQIHQ, seg_pos={0 0}, upload=414748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Jul 14 23:47:30.507634788 (518h36m30.391048419s) [seg_pos={0 0}, upload=414748]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Jul 14 23:47:30.507717732 (518h36m30.391131358s) [upload=414748]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 23:47:30.507724547 (518h36m30.391138177s) [upload=414748]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 23:47:30.547070340 (518h36m30.430483976s) [upload=414748]: Done uploading segments... Jul 14 23:47:30.547094478 (518h36m30.430508105s) [upload=414748]: Upload finished. err: <nil> Jul 14 23:47:30.863955222 (518h36m30.747368849s) [upload=414749]: Starting upload Jul 14 23:47:30.864023814 (518h36m30.747437456s) [upload=414749]: Done starting upload Jul 14 23:47:30.864126584 (518h36m30.747540202s) [upload=414749]: Uploading segments... Jul 14 23:47:30.864360135 (518h36m30.747773761s) [upload=414749]: Got next segment. Inline: false Jul 14 23:47:30.864426077 (518h36m30.747839704s) [upload=414749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 23:47:30.864431154 (518h36m30.747844779s) [upload=414749]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 23:47:30.867084429 (518h36m30.750498058s) [upload=414749]: Next segment err: metaclient: Too Many Requests Jul 14 23:47:30.867113197 (518h36m30.750526824s) [upload=414749]: Done uploading segments... Jul 14 23:47:30.867126113 (518h36m30.750539725s) [upload=414749]: Upload finished. err: metaclient: Too Many Requests Duration: 460.249939ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 2.874652404s FAIL (2025-07-15 00:03:34 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout Duration: 2.874750112s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 33.169081ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-07-15 00:03:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41928->127.0.0.1:53: i/o timeout Duration: 33.252557ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..X.................................X.......................] duration: 519.589885ms target: https://ap1.storj.io/login FAIL (2025-07-15 00:03:32 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:60425->127.0.0.1:53: i/o timeout Duration: 519.619029ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X........X.......................] duration: 1.94520346s FAIL (2025-07-15 00:03:27 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.94524433s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)