Python
ScalaThe Sr. Analytics Engineer would provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective.
Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.
Provides data understanding and coordinates data-related activities with other data management groups such as master data management, data governance, and metadata management.
Actively participates with other consultants in problem-solving and approach development.
Responsibilities :
Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.
Perform data analysis to validate data models and to confirm the ability to meet business needs.
Assist with and support setting the data architecture direction, ensuring data architecture deliverables are developed, ensuring compliance to standards and guidelines, implementing the data architecture, and supporting technical developers at a project or business unit level.
Coordinate and consult with the Data Architect, project manager, client business staff, client technical staff and project developers in data architecture best practices and anything else that is data related at the project or business unit levels.
Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.
Coordinate with Data Architects, Program Managers and participate in recurring meetings.
Help and mentor team members to understand the data model and subject areas.
Ensure that the team adheres to best practices and guidelines.
Requirements :
- Strong working knowledge of at least 3 years of Spark, Java/Scala/Pyspark, Kafka, Git, Unix / Linux, and ETL pipeline designing.
- Experience with Spark optimization/tuning/resource allocations
- Excellent understanding of IN memory distributed computing frameworks like Spark and its parameter tuning, writing optimized workflow sequences.
- Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).
- Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.
- Have a deep understanding of the various stacks and components of the Big Data ecosystem.
- Hands-on experience with Python is a huge plus
Shubham Vishwakarma
Full Stack Developer - Averlon
About The Modern Data Company
About
Homepage - TheModernDataCompany
Company social profiles
Similar jobs
C#Job Title: Senior .NET Developer (Remote)
Experience: 7+ Years Location: India (Remote)
Apply:jobs[at]cookieanalytix[dot]net
Company Overview: We are a dynamic and rapidly growing tech company looking for a talented Senior .NET Developer to join our team. As a Senior .NET Developer, you will work with a team of skilled professionals to build high-quality, scalable applications and contribute to the development of innovative software solutions.
Key Responsibilities:
* Design, develop, and maintain high-performance applications using .NET technologies.
* Collaborate with cross-functional teams to define, design, and ship new features.
* Write clean, maintainable, and efficient code.
* Optimize and troubleshoot SQL queries for database performance.
* Work with large, complex data sets and ensure the integrity of the database.
* Participate in code reviews and contribute to best practices for software development.
* Continuously improve development processes and implement automation where possible.
* Ensure all applications meet quality standards and provide excellent user experiences.
Required Skills and Experience:
* 7+ years of experience as a .NET Developer with a proven track record of designing and developing scalable applications.
* Strong proficiency in ASP.Net, C#, Web API, React/ Angular, Entity Framework.
* Solid experience with SQL Server, including database design, writing optimized queries, and performance tuning.
* Excellent problem-solving skills and the ability to debug and optimize complex systems.
* Strong communication skills with the ability to work independently and as part of a team in a remote setting.
Why Join Us?
* Work from the comfort of your own home in a fully remote environment.
* Opportunity to work on innovative and challenging projects.
* Collaborative and inclusive work culture.
Javascript
.NETC#Technical Experience :
- Net development work experience.
- Proficiency in NET Development with Asp.net and MVC.
- Strong object-oriented programming OOPS design skills, SOLID principles and proficiency in software design patterns.
- Experience in database MS SQL Server.
- Experience with version control systems GitHub and Bitbucket.
Professional Attributes :
1. Should have good communication Skills.
2. Should be a good team player.
3. Should be able to work independently and under pressure.
4. Should have good logical and analytical thinking.
Python
Amazon Web Services (AWS)
Django- Bachelor's Degree or equivalent experience.
- 5-8 years of experience with software development, preferably in Agile environment.
- Advanced knowledge of in software development tools, programming languages, databases, and environments, including but not limited to:
- Python 3.x, Django, functional Python, procedural Python, object oriented Python, Asynchronous Design, Micro Services, memcache, REDIS, Celery, ElastiSearch, RESTful web services, Relational (Oracle & MySQL) and Non-Relational (NOSQL & DynamoDB) databases, AWS.
JavaJob Description
· Strong Core Java / C++ experience with Strong Handson Coding
· Excellent understanding of Logical ,Object-oriented design patterns, algorithms and data structures.
· Sound knowledge of application access methods including authentication mechanisms, API quota limits, as well as different endpoint REST, Java etc
· Strong exp in databases - not just a SQL Programmer but with knowledge of DB internals
· Sound knowledge of Cloud database available as service is plus (RDS, CloudSQL, Google BigQuery, Snowflake )
· Experience working in any cloud environment and microservices based architecture utilizing GCP, Kubernetes, Docker, CircleCI, Azure or similar technologies
NodeJS (Node.js)Python
Ruby on Rails (ROR)
ExpressResponsibilities:
- Build scalable, service oriented web applications from scratch for technology products for European market.
- Maintain these applications for accuracy and high availability.
- Continuously identify opportunities to improve system designs, architecture and implementation standards
- Participate with founding, business and product teams in discussions on how to build and launch new modules.
- Collaborate across functions and own the planning, estimation and execution for parts of the product.
- Start as an individual contributor but stay ready to build and mentor a small team of up to 5 engineers over the coming months and years.
- Contribute in hiring highly ambitious engineers as the team grows.
- Being among the first people on the engineering team, be a culture driver.
Requirements:
- Experience of architecting and building products/business critical backend applications using different MVC frameworks.
- Experience with microservices.
- Experience of building and maintaining scalable applications using Node.js/MEAN stack.
- Experience of deploying and maintaining web applications.
- Experience with non relational databases like MongoDB.
- Understanding of relational databases like MySQL.
- Familiarity with REST APIs and stress testing tools.
- Good communication skills.
- Exposure in building polyglot applications.
- Exposure for devops and related processes, preferably GCP.
- Knowledge of components in scalable solutions i. e. database partitions, message brokers, background processing.
- Exposure to basic frontend technologies to speed up collaboration with the frontend team.
Python
FlaskDjangoLooking for a Python Backend Developer to join our client’s award-winning, talented team,
building the next generation automated drone applications for our global customers.
Some Roles/Responsibilities
● Designing, implementing and deploying updates, features to the company’s cloud
backend system. The work typically requires writing RESTful APIs.
● Derive key metrics from the system to estimate system health and performance.
● Prepare automated test suites for continuous health monitoring of the backend
systems.
● Perform load testing to understand potential scale issues and take corrective
measures.
● Integrate tools for incidence report and response, to ensure high availability of
the backend system.
● Drive Security practices implementation. (Troubleshoot incidents, identify root
cause, configuration, fix and document problems, patching systems for
vulnerabilities, and implement preventive measures)
● Maintain codes, users and API documentation.
● Setting up the CI/CD automation environment for web applications using
Jenkins/ECS.
● Manage Linux Virtual machines on EC2 ensuring correct VPC, Security Group
settings.
● Integrate automated data pipelines to enable analysis of usage patterns on 3rd
party analytics platforms.
Experience required: 3+ years relevant experience
Must Haves Skils-
Flask/Django, Python Backend Exp, Exp in Websockets, Async IO
Notice Period- Immediate/1months/ 2 months negotiable
Java
C++Requires a bachelor's degree in area of specialty and experience in the field or in a related area. Familiar with standard concepts, practices, and procedures within a particular field. Relies on experience and judgment to plan and accomplish goals. Performs a variety of tasks. A degree of creativity and latitude is required. Typically reports to a supervisor or manager.
Designs, develops, and implements web-based Java applications to support business requirements. Follows approved life cycle methodologies, creates design documents, and performs program coding and testing. Resolves technical issues through debugging, research, and investigation.
Additional Job Details:
Strong in Java, Spring, Spring Boot, REST and developing MicroServices.
Knowledge or experience , Cassandra preferred
Knowledge or experience on Kafka
Good to have but not must
Good to know:
Reporting tools like Splunk/Grafana
Protobuf
Python/Ruby
PHPNodeJS (Node.js)JavascriptPythonRuby on Rails (ROR)PythonDjangoFlaskJavascriptPythonNodeJS (Node.js)DjangoPHP
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon