Build a production-ready web crawling and AI lead-qualification application: crawl and extract website content, analyze with LLMs to score/qualify industry-specific leads, produce structured outputs, and deliver a maintainable handover-ready product.
This is a remote position.
MENA Alliances is hiring a Web Crawling & AI Lead Qualification Engineer to develop a smart tool that identifies and evaluates potential business leads.
In this role, you will build a web crawling and AI-powered lead qualification application that takes a list of company websites, extracts relevant content, and uses AI to determine whether those companies are strong marketing targets for specific industry sectors (such as utilities or telecom).
The final deliverable should be a clean, maintainable, and handover-ready product that the end client can easily operate and expand.
- Develop a web crawling and scraping system to collect relevant data from a list of websites.
- Extract and process meaningful content from crawled pages.
- Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical.
- Design a scoring or ranking mechanism that qualifies and prioritizes leads.
- Produce a structured output containing qualified leads with clear reasoning or scoring.
- Deliver a standalone, well-structured application ready for handover to the client.
RequirementsTechnical Requirements
- Experience with web scraping and crawling tools such as BeautifulSoup, Scrapy, Playwright, Puppeteer, or similar frameworks.
- Strong knowledge of content extraction and text analysis.
- Hands-on experience integrating AI / LLM APIs (e.g., OpenAI, Anthropic, or open-source models).
- Ability to design and build clean, maintainable software products, not just quick prototypes.
- Familiarity with modern development stacks and best practices.
- Experience in lead generation, marketing technology, or sales intelligence tools.
- Knowledge of prompt engineering, particularly for multilingual or non-English content.
- Experience building end-to-end AI-powered tools or automation solutions.
- German language skills are a plus but not required (language support will be provided by the client).
Benefits
Similar Jobs
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead Talent & Development for the CSS unit: act as single point of contact for talent management, translate global processes into unit solutions, partner with TR/TA and global SMEs, design and deploy development strategies, measure outcomes using OKRs and analytics, and drive stakeholder engagement across EMEA.
Cloud • Security • Software • Cybersecurity • Automation
Lead backend work for GitLab's Spec-Driven Development: design and build APIs, data models, evaluation systems, and agent-driven workflows using Ruby on Rails and Python. Ship production services, benchmark LLM workflows, coordinate multi-person projects, mentor engineers, and collaborate with product and design in an all-remote, async environment.
Top Skills:
Ai GatewayGitlabGitlab Duo Agent PlatformGraphQLLarge Language Model ApisPostgresPythonRestRubyRuby On RailsSQL
Cloud • Security • Software • Cybersecurity • Automation
Build and maintain backend services for repository management using Ruby and GraphQL. Implement secure, well-tested, performant features, tune database queries, caching, and background jobs. Collaborate cross-functionally, improve observability and reliability, participate in Tier 2 on-call and incident response, and integrate AI tools responsibly to accelerate development.
Top Skills:
Ai Coding ToolsBackground ProcessingCachingGitGitalyGraphQLObservabilityRelational DatabasesRubySQL
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
