Senior Data Engineer
OP Labs
Estimated Salary: $105K-$175K
Location: Remote
### What are the role responsibilities?
* Collaborating with business teams to design systems architecture:
+ Design and implement robust, scalable, and optimized data architectures.
+ Lead the development and maintenance of scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.
* Pipeline ownership:
+ Develop integrations with third party systems to source, qualify and ingest various datasets.
+ Develop data set processes for data modeling and production.
+ Recommend and implement ways to improve data reliability, efficiency, and quality.
* Data strategy and execution:
+ Work with stakeholders including the Marketing, Product, Analytics, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
* BI and data tool enablement:
+ Enable data analytics and visualization tools to extract valuable insights from the data to enable data-driven decisions
* Innovation and improvement:
+ Keep up-to-date with the latest industry trends in data engineering.
+ Explore new technologies and approaches for continuous improvement of data systems.
* Collaboration and communication:
+ Work closely with analytics and business teams to define and refine data requirements for various data and analytics initiatives.
+ Ensure clear communication of project progress and results to stakeholders.
+ Collaborate with data engineers across the wider OP stack and ecosystem to enable open source and publicly available datasets.
### What skills do you bring?
* 4+ years of professional data engineering experience
* Advanced working knowledge of SQL, Python, and experience with relational databases
* Experience in building and optimizing 'big data' data pipelines, architectures, and data sets
* Experience with big data tools: Hadoop, Spark, Kafka, etc.
* Experience with workflow orchestration management such as Airflow, dbt etc.
* Experience with Cloud Services such as Google Cloud Services, AWS, etc.
* Strong analytic skills related to working with unstructured datasets, we are looking for an engineer who can understand the business and how to build to requirements
* Excellent communication skills with the ability to engage, influence, and inspire partners and stakeholders to drive collaboration and alignment
* Self-starter who takes ownership, gets results, and enjoys the autonomy of architecting from the ground up
* Experience with web3 and blockchain protocols is a plus