Python Developer

The Sr. Analytics Engineer would provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective.

Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.

Provides data understanding and coordinates data-related activities with other data management groups such as master data management, data governance, and metadata management.

Actively participates with other consultants in problem-solving and approach development.

Responsibilities :

Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.

Perform data analysis to validate data models and to confirm the ability to meet business needs.

Assist with and support setting the data architecture direction, ensuring data architecture deliverables are developed, ensuring compliance to standards and guidelines, implementing the data architecture, and supporting technical developers at a project or business unit level.

Coordinate and consult with the Data Architect, project manager, client business staff, client technical staff and project developers in data architecture best practices and anything else that is data related at the project or business unit levels.

Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.

Coordinate with Data Architects, Program Managers and participate in recurring meetings.

Help and mentor team members to understand the data model and subject areas.

Ensure that the team adheres to best practices and guidelines.

Requirements :

- Strong working knowledge of at least 3 years of Spark, Java/Scala/Pyspark, Kafka, Git, Unix / Linux, and ETL pipeline designing.

- Experience with Spark optimization/tuning/resource allocations

- Excellent understanding of IN memory distributed computing frameworks like Spark and its parameter tuning, writing optimized workflow sequences.

- Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).

- Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.

- Have a deep understanding of the various stacks and components of the Big Data ecosystem.

- Hands-on experience with Python is a huge plus

Egen is a data engineering and cloud modernization firm helping industry-leading companies achieve digital breakthroughs and deliver for the future, today. We are catalysts for change who create digital breakthroughs at warp speed. Our team of cloud and data engineering experts are trusted by top clients in pursuit of the extraordinary. An Inc. 5000 Fastest Growing Company 7 times, and recently recognized on the Crain’s Chicago Business Fast 50 list, Egen has also been recognized as a great place to work 3 times.

You will join a team of insatiably curious data engineers, software architects, and product experts who never settle for "good enough". Our Java Platform team's tech stack is based on Java8 (Spring Boot) and RESTful web services. We typically build and deploy applications as cloud-native Kubernetes microservices and integrate with scalable technologies such as Kafka in Docker container environments. Our developers work in an agile process to efficiently deliver high value data driven applications and product packages.

Required Experience:

• Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
• Have experience working and strong understanding of object-oriented programing and cloud technologies
• End to end experience delivering production ready code with Java8, Spring Boot, Spring Data, and API libraries
• Strong experience with unit and integration testing of the Spring Boot APIs.
• Strong understanding and production experience of RESTful API's and microservice architecture.
• Strong understanding of SQL databases and NoSQL databases and experience with writing abstraction layers to communicate with the databases.

Nice to have's (but not required):

• Exposure to Kotlin or other JVM programming languages
• Strong understanding and production experience working with Docker container environments
• Strong understanding and production experience working with Kafka
• Cloud Environments: AWS, GCP or Azure

Key Responsibilities: 

• Rewrite existing APIs in NodeJS. 
• Remodel the APIs into Micro services-based architecture. 
• Implement a caching layer wherever possible. 
• Optimize the API for high performance and scalability. 
• Write unit tests for API Testing.
• Automate the code testing and deployment process.

Skills Required: 

• At least 3 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds. 
• Excellent hands-on experience using MySQL or any other SQL Database. 
• Good knowledge of MongoDB or any other NoSQL Database. 
• Good knowledge of Redis, its data types, and their use cases. 
• Experience with graph-based databases like GraphQL and Neo4j. 
• Experience developing and deploying REST APIs. 
• Good knowledge of Unit Testing and available Test Frameworks. 
• Good understanding of advanced JS libraries and frameworks. 
• Experience with Web sockets, Service Workers, and Web Push Notifications. 
• Familiar with NodeJS profiling tools. 
• Proficient understanding of code versioning tools such as Git. 
• Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms. 
• Should be a fast learner and a go-getter — without any fear of trying out new things Preferences. 
• Experience building a large-scale social or location-based app.

Desired Candidate Profile

• A team focus with strong collaboration and communication skills
• Exceptional ability to quickly grasp high-level business goals, derive requirements, and translate them into effective technical solutions
• Exceptional object-oriented thinking, design and programming skills (Java 8 or 11)
• Expertise with the following technologies : Data Structures, Design Patterns ,Code Versioning Tools(Github/bitbucket/..), XML, JSON, Spring Batch Restful, Spring Cloud, Grafana(Knowledge/Experience), Kafka, Spring Boot, Microservices, DB/NoSQL, Docker, Kubernetes, AWS/GCP, Architecture design (Patterns) Agile, JIRA.
• Penchant toward self-motivation and continuous improvement; these words should describe you: dedicated, energetic, curious, conscientious, and flexible.

Roles & Responsibilities:

• You will be coordinating our enterprise account-specific teams called squads, consisting of members from engineering, machine-learning, and conversation-design teams.
• There are five working groups in the organization, (i) Business (ii) Research (iii) Solutions (iv) Product, and (v) Operations, where you will be joining the Solutions, working group.
• You will be collaborating with the sales team to design an appropriate solution to the customer's problems and help them showcase the value of the product.
• You will be collaborating with the operations team to ensure we are not compromising on our quality standards.
• You will also be co-working with the product working group to help them improve the overall platform and to prioritize the high-impact initiatives in the roadmap.

Work you will be doing:

• You will be building bespoke voice bots for enterprise clients using internal tools.
• You're expected to help build the Solutions stack whose goal is to reduce the amount of effort put into building our voice bots. 
• You will be involved in analyzing client calls where you're expected to use either data pipelines or SQL to get insights into caller behavior.

• Professional experience of at least 1 year.
• Has experience with integrating or building HTTP APIs
• Has hands-on experience working with Python
• Good communicator

Optional Requirements:

• Has experience working in any of Django Rest Framework, Redis, Celery

Skit uses a microservices architecture where we employ both HTTP and GRPC to communicate between our services