Software Engineer

Job description

Why Join the employer? At the employer, we don’t just extract web data—we tackle some of the internet’s trickiest data collection challenges at a massive scale. We’re a globally distributed team of bold, curious problem-solvers dedicated to delivering clean, reliable web data wherever it’s needed. • We live and breathe data: We unlock access to open web data, helping everyone from scrappy startups to global enterprises power competitive intelligence, analytics, and cutting-edge AI models. • Truly remote-first: Work from wherever you thrive. With more than 260 Zytans spread across 33 countries, our diversity is our greatest strength. • Engineering excellence: We love rolling up our sleeves to dig into complex codebases, test out fresh technologies, and push technical limits. If you love creative problem-solving and delivering rock-solid production software, you’ll feel right at home here. • Thoughtful architecture: We use a clear system design framework to balance functional needs with architectural trade-offs, making sure our decisions are smart and sustainable. • Fascinating distributed systems: Solve unique engineering problems across custom networking, high-throughput streaming, and large-scale orchestration under real-world constraints. • Real ownership: Work on a profitable, industry-leading platform that dedicatedly sets aside time and resources for architectural research and long-term feature design. What Is This Role All About? When the employer API fetches web data, it works through a progressive ladder of routes: standard HTTP requests, headless browsers, and, for the toughest sites, Edge—our custom residential network of real physical devices. Edge is our heavy hitter when all else fails. It runs a Rust peer runtime on residential Windows PCs that long-polls our command-and-control service over mTLS gRPC, making fetches look indistinguishable from real human traffic using genuine hardware, residential IPs, and seamless fingerprints. Our Edge Platf…