The Sr. Analytics Engineer would provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective.
Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.
Provides data understanding and coordinates data-related activities with other data management groups such as master data management, data governance, and metadata management.
Actively participates with other consultants in problem-solving and approach development.
Responsibilities :
Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.
Perform data analysis to validate data models and to confirm the ability to meet business needs.
Assist with and support setting the data architecture direction, ensuring data architecture deliverables are developed, ensuring compliance to standards and guidelines, implementing the data architecture, and supporting technical developers at a project or business unit level.
Coordinate and consult with the Data Architect, project manager, client business staff, client technical staff and project developers in data architecture best practices and anything else that is data related at the project or business unit levels.
Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.
Coordinate with Data Architects, Program Managers and participate in recurring meetings.
Help and mentor team members to understand the data model and subject areas.
Ensure that the team adheres to best practices and guidelines.
Requirements :
- Strong working knowledge of at least 3 years of Spark, Java/Scala/Pyspark, Kafka, Git, Unix / Linux, and ETL pipeline designing.
- Experience with Spark optimization/tuning/resource allocations
- Excellent understanding of IN memory distributed computing frameworks like Spark and its parameter tuning, writing optimized workflow sequences.
- Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).
- Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.
- Have a deep understanding of the various stacks and components of the Big Data ecosystem.
- Hands-on experience with Python is a huge plus
Similar jobs
Python Full stack developer.
1. Product based Full stack developer - Python back end - Core Python
2. Worked with Database - MongoDB/ MySql
3. Should have worked with ORMs
4. Knowledge of REST APIs
5. Should have developed Python applications.
6. Cloud Technology - Worked with AWS/ Azure. Not yet decided on what we
are going to go with.
7. Deplyment tools knowledge
8. Good knowledge of Front end dev - CSS/ JS/ React
9. Version Control - Git
10. Frameworks - Flask/ Django. (Ideally Flask)
11. Script writing
Should have worked on a full system design and architecture along with
coding up the same.
Job Description:
Key Responsibility Areas: |
· Perform validation and verification testing and debud code. · Work collaboratively with others to achieve goals · Experience working in an agile environment |
Required Skills: |
· Experience in implementing Object-Oriented Python, Django. · Good understanding on Django ORM. · Experienced in interfacing with *third party API’s using REST · Worked with varieties of Relational Databases (RDBMS) like SQLite, MySQL, PostgreSQL. · Experience in Version Control with Git and Bitbucket. · Experience with JIRA the development progress and tracking deadlines of the project · Experience with web applications using technologies like HTML5,CSS, JavaScript, JQuery, AJAX, Angularjs,Reactjs and Bootstrap,XML. · Knowledge in Pandas, Numpy will be addons |
Qualification |
Bachelor of Engineering in Computer Science , MCA |
With over 40 years of innovation, Quantum's end-to-end platform is uniquely equipped to orchestrate protect, and enrich data across its lifecycle, providing enhanced intelligence and actionable insights. Leading organizations in cloud services, entertainment, government, research, education, transportation, and enterprise IT trust Quantum to bring their data to life, because data makes life better, safer, and smarter. Quantum is listed on Nasdaq (QMCO) and the Russell 2000® Index. For more information visit www.quantum.com.
As a Software Engineer, you will collaborate with engineers and product managers on the development and maintenance of Quantum’s DXi-Series of disk-based backup appliance software. Quantum’s DXi series protects our customers data on premises, in the cloud, or in a hybrid environment.
You Are A Part Of:
DXi is a uniquely powerful solution within the Quantum portfolio, allowing customers to meet and exceed their backup needs with one of the fastest products on the market. You’ll work on a product that allows customers to reduce costs, maximize production, scale with ease, and positively impact the environment by reducing power and cooling requirements.
Job Responsibilities:
Responsibilities include, but are not limited to:
• Write code primarily for Linux systems, with programming languages including Python, C, C++, and Perl.
• Design and build differentiating feature sets that continue to expand product capabilities, both on premises and in the cloud.
• Work with development, test, service, and support engineers to develop tactical solutions for customer issues.
• May design and develop automated test suites.
• May maintain lab equipment.
Required Skills and/or Experience:
• Bachelor’s degree in Computer Science, Information Technology, or related field of study required.
• 5-10 years related industry experience required.
• 5+ years software development in C or C++ is required.
• 3-5 years’ experience working in a Linux environment is required.
• Experience in writing scripts: Perl, shell, bash, and/or other scripting tools is required.
• Experience with debugging tools such as GDB is required.
• Experience with source control and shared build environments is required.
3+ years of experience with development in JAVA technology.
Strong Java Basics
SpringBoot or Spring MVC
Hands-on experience with Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
Proficient in REST API development
Messaging Queue (RabitMQ or Kafka)
Microservices
Any Caching Mechanism
Good at problem-solving
Good to Have Skills:
4+ years of experience in using Java/J2EE tech stacks
Good understanding of data structures and algorithms.
Excellent analytical and problem-solving skills.
Ability to work in a fast-paced internet start-up environment.
Experience in technical mentorship/coaching is highly desirable.
Understanding of AI/ML algorithms is a plus.
3+ years of hands-on experience in Go Lang & its design patterns
Worked in telecom domain
Good understanding of events & handler
Strong understanding & hands on experience in concurrency, go routines & channels
Strong understanding & hands on experience in Spring frameworks and their modules
Integration experience with REST or SOAP APIs
Strong hands-on experience in webservices and API
Good to have:
Docker & Kubernetes
Python development knowledge
Experience in Cloud technologies
Soft Skills:
Good communication skills & presentation skills.
Self-driven work attitude
Should be independently able to drive the tasks.
We are hiring for Backend Developer for Pune Kharadi.
Experience: Min 2+ Years with Python/Django.
Must have Skills:
- Excellent knowledge of Python/Django code structure.
- Good understanding of Design patterns and OOPS concepts.
- Good understanding of ORM.
- Good understanding of PostgreSQL.
- Better to have code optimization techniques.
- Implementing integrated technology-based solutions and identifying integration opportunities for a similar package of services.
- Excellent knowledge of Linux, Nginx.
- Excellent knowledge of celery, RabbitMQ
- Excellent Knowledge of Git.
Additional skills:
- Knowledge in Docker and Kubernetes is a plus.
- Good to have some knowledge of Angular and some frontend technologies like Html, CSS, Java script.
- Should take responsibility and ownership of delivery.
Education & Qualifications:
- Must have a Graduate/Master’s degree in any vertical or global equivalent from a reputed university.
- Certification in Python/data science would be added advantage.
1. Work experience between 3 years to 9 years in building large scale high user traffic consumer facing applications with desire to work in a fast paced startup.
2. Knowledge on reactive and asynchronous programming is preferable. If you have worked with coroutines, goroutines, high concurrency or optimized number of threads for processing on your backend server you could be a good fit.
3. Extremely proficient at writing performant, scalable and production ready code in Kotlin, Java (8 or above, comfortable with concepts like lambda, streams, multithreading etc), Elixir, Rust, or Golang. Should be familiar with static code analysis, code coverage and code reviews.
4. Experience with NoSQL DBs like MongoDB, Cassandra, Redis or Aerospike is required. Knowledge of graph DBs like Neo4j is preferred.
5. Strong in algorithms, problem solving and data structures.
6. Knowledge of TDD and experience with building applications integrated with CI-CD pipelines (automated build, tests and deployments).
7. Exposure to micro-services with good understanding of containers, kubernetes, logging, alerting and monitoring. Inter services communication. Should know how to handle multiple versions of APIs.
Who We are?
At e6data (https://e6x.io/" target="_blank">https://e6data.io) we’re building core algorithms that make querying 25 - 200X more performant (i.e. faster and/or cheaper) than every other analytics platform in the world. This results in billions of dollars of value unlocked across faster analytics, savings on computing/infra, and new use cases become possible.
Our core team has 100+ years of combined experience and 10+ patents across diverse but complementary disciplines like real-time databases, time-series databases, SQL OLAP engines, distributed computing platforms, stream processing, and log analytics. Two of the founding team are second-time founders with past exits.
We are passionate about solving the deepest and most important problems in computer science and believe in making our technology available to customers regardless of their location, size, or budget. Our vision is for e6data to power every analytical workload in the world - regardless of deployment scenario (cloud, on-premise, edge), across every use case (end-user queries, ETL / data pipelines), and every latency requirement (batch, streaming / real-time).
What you will do?
- Write awesome code
- Your primary focus will be on building our product around our core algorithms. You will collaborate with our Performance Engineering and DevOps teams.
- Identify tactical and long-term product improvements (could be code, script, etc.) so that e6data development is based on frictionless onboarding of customers
- Build our internal Data Platform using e6data
- Adding scalable functionality to the core e6data engine for new features like UDFs, SQL functions, etc
What we are looking for?
- Worked with Java for a minimum of 4 years
- Knowledge of SQL Query planning will also be good to have
- A passion for continuous learning and growth (both at a personal and team level)
- Strong team player
- Experience (or enjoys) working in a startup will be an added advantag
- Bachelors degree in Computer Science, Software Engineering, or a related discipline
- Experience working in an IT environment
- Experience developing with C#, C++, or other object-oriented platforms
- 2+ years of web application development
- Skill for writing reusable libraries
- Hands-on experience in ASP.Net, MVC, Restful services, Web API
- Experience in .Net Web API
- Strong understanding of object-oriented programming
- Strong knowledge of C# programming
- Ability to troubleshoot problems independently. Good analytical and problem-solving skills
- Familiar with various design and architectural patterns
- Strong Knowledge in Microsoft SQL Server scripts and Stored procedures
- Exposure to Agile Software Development Life Cycle
- Experience implementing automated testing platforms and unit tests
- Proficient understanding of code versioning tools such as GIT
- Experience in Service-based architecture