Lead design and development of scalable data pipelines, optimize ETL processes, ensure platform quality, and collaborate across teams to enhance data architecture.
Summary
The Data Platform team at Pismo is responsible for integrating data produced by Pismo's Banking as a Service/Payments platform with its clients, whether through batch processing (files) or near real-time (events). With a robust, low-latency, and 100% cloud-based architecture, the team excels in
technology and fosters a strong culture of collaboration, partnership, and data-driven decision making for platform development and project prioritization.
What you'll do- Serve as a senior technical contributor on Pismo’s data stack, leading the design and development of robust, scalable data pipelines using modern Big Data frameworks.
- Drive continuous improvement in platform performance, reliability, and cost-effectiveness, proactively identifying opportunities for innovation.
- Take ownership of production operations and monitoring (file- and event-based systems), ensuring adherence to SLAs and applying best practices for observability and resilience.
- Collaborate with cross-functional teams to architect, build, and evolve high-complexity data features, reducing technical debt and championing engineering excellence.
- Provide mentorship to peers through code reviews, feedback, and support, fostering an environment of knowledge sharing and professional development.
- Participate in on-call rotations, promptly addressing and resolving production incidents, while proactively implementing preventative measures.
- Build and optimize ETL/ELT processes to handle large-scale data, leveraging advanced data processing and distributed systems techniques.
- Maintain rigorous data governance and platform standards, working closely with data stakeholders to ensure consistent, high-quality data assets.
- Introduce and adopt new technologies, tools, or techniques that accelerate development cycles, improve performance, and reduce costs.
- Conduct root-cause analyses for critical issues, challenging and refining team processes to enhance efficiency and reliability.
- Influence multiple teams by promoting a culture of technical excellence, forward-thinking solutions, and continuous improvement.
Technical Skills:
- 3+ Years experience with Golang
- 3+ Years experience with AWS Services ( Lambda, SQS, S3 )
- 2+ Years experience with Terraform
- Software Engineering experience ( building steaming applications / data platforms )
- Python experience
--
Pismo is an Equal Employment Opportunity employer that proudly pursues and hires a diverse workforce. Pismo does not make hiring or employment decisions on the basis of race, color, religion or religious belief, ethnic or national origin, nationality, sex, gender, gender identity, sexual orientation, disability, age or any other basis protected by applicable laws or prohibited by company policy. Pismo also strives for a healthy and safe workplace and strictly prohibits harassment of any kind.
Top Skills
AWS
Go
Python
Terraform
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Senior Data Engineer will design, build, and deploy AWS-based data pipelines for financial services, mentor junior engineers, and ensure scalable, secure architectures.
Top Skills:
Aws GlueAws LambdaAws RdsAws RedshiftAws Step FunctionsBoto3HadoopJavaKafkaKinesisPythonScalaSparkSpark Streaming
Financial Services
As a Senior Data Engineer, you will develop data architectures, ensure regulatory compliance, and lead data initiatives within Wholesale Credit Risk.
Top Skills:
SparkAWSAzureDatabricksDelta LakeGCPHadoopJavaKafkaKubernetesPythonSnowflakeSQL
Healthtech • Software • Biotech • Pharmaceutical
As a Senior Site Reliability Engineer, you'll design and maintain scalable data pipelines, monitor data health, and optimize cloud infrastructure.
Top Skills:
AirflowAmazon RdsAnsibleAWSDatabricksDockerGitlab Ci/CdKubernetesPythonSnowflakeSparkTerraform
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
