Perl & Python programmer

Minimum requirements

5+ years of industry software engineering experience (does not include internships nor includes co-ops)

Strong coding skills in any programming language (we understand new languages can be learned on the job so our interview process is language agnostic)

Strong collaboration skills, can work across workstreams within your team and contribute to your peers’ success

Have the ability to thrive on a high level of autonomy, responsibility, and think of yourself as entrepreneurial

Interest in working as a generalist across varying technologies and stacks to solve problems and delight both internal and external users

Preferred Qualifications

Experience with large-scale financial tracking systems

Good understanding and practical knowledge in cloud based services (e.g. gRPC, GraphQL, Docker/Kubernetes, cloud services such as AWS, etc.)

• Hands-on development and optimization of image enhancing algorithms for image processing using computational imaging
• Working with peer teams on researching and resolving complex software and system problems
• Analvze and optimize different methodologies to improve output of image processing
• Work closely with Quality Assurance teams to refine algorithms for optimal system performance
• Support products from the early development and prototyping phases through to production
• Developing functional specifications per customer requirements
• Good understanding of image processing techniques such as edge detection skills, image alignment, removing noise, image segmentation, correction/modification, compression, and image reconstruction

Relevant Experience

3 to 10 years

Job Description and Key Skills Required:

• Hands-on with any of the programming languages like NodeJS/ExpressJS, Python, Java, Php or any.
• Design and create efficient RESTful API endpoints for both internal and public consumption
• Strong understanding of database technologies such as MySQL, Postgress, Oracle , relational Database.
• Work closely with front end developers to understand required data model
• Comfortable deploying applications on AWS, and have a strong working knowledge of EC2, RDS and S3.
• Must understand overall system design, architecture , improve design and implement new processes.
• Strong understanding of sessions, cookies & local storage is must.
• Experience with in memory databases like redis basic, Memcache
• Independently think of solutions to complex requirements; possess exceptional logical skills.
• Analyse current products in development, including performance, scalability, diagnosis and troubleshooting.
• Work with the existing framework and evolve it by building reusable code & libraries
• Search and introduce new software related technologies, processes and tools.
• Bonus: You're fluent with React.
• Bonus: Interested in full-stack development.
• Bonus: Any experience of iOS/Android mobile development.
• Bonus: Experience with CI servers such as Jenkins, Travis or similar types
• Bonus: Experience with web server like Nginx

Minimum of 4+ years of experience in Java development

• Experience delivering Services (REST, SOAP) and Web applications in Micro services architecture
• Experience developing and deploying Java solutions to cloud
• Experience in Spring Boot and components of Spring framework
• Experience in a JavaScript framework such as Angular or React
• Experience in TDD using Junit or similar frameworks

·       Experience in Design Patterns and service oriented architectural principles, Data structures and Algorithms.

·       Individual should be an active participant in the product design and code reviews for self and team and can competently review any aspect of their product or major sub-system.

·       Experience in SQL, Unix skills.

·       Good communication Skill

Roles and responsibilities

• Develop well-designed performant and scalable applications and microservices
• Writing reusable, testable, and efficient code aligning to software development best practices
• Integrate data storage solutions including databases, key-value stores, blob stores, etc.
• Build integrations with 3rd party applications through apis’ to ingest and process data
• Develop state-of-the-art analytics tools to support diverse tasks ranging from ad hoc analysis to production-grade pipelines and workflows for customer applications
• Ensure security and data protection aspects within the applications
• Partner with Data Scientists and Analytics Engineers to improve the performance and reliability of advanced algorithms
• Ensure high performance and availability of distributed systems and applications
• Interact directly with client project team members and operational staff to support live customer deployments and production issues

• 4+ years of experience in developing applications using python and related technologies.
• Familiarity in data ingestion and processing libraries in python.
• Thorough understanding of REST and GRPC technologies.
• Experience in using ORM (Object Relational Mapper) libraries for data access.
• Experiencing in developing and hosting APIs and integration with external applications.
• Experience in building data models and repositories using relational and NoSql databases.
• Knowledge of JIRA, Bitbucket and agile methodologies.
• Good to have knowledge of AWS services like Lambda, dynamodb, kinesis and others.
• Understanding of fundamental design principles behind a scalable application
• Familiarity with event-driven programming
• Strong unit test and debugging skills
• Affinity for learning and applying new technologies and solving new problems
• Effective organizational skills with strong attention to detail
• Experience in working with docker is a plus
• Comfortable in working with Unix/Linux environment
• Strong communication skills — both written and verbal

Be Part Of Building The Future

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.

Responsibilities & ownership

• Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
• Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
• Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
• Lead the team to solve complex and unknown problems 
• Solve technical problems and customer issues with technical expertise
• Design and deliver architectures that run optimally on public clouds like  GCP, AWS, and Azure
• Mentor other team members for high quality and design 
• Collaborate with Product Management to deliver on customer requirements and innovation
• Collaborate with Support and field teams to ensure that customers are successful with Dremio

Requirements

• B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
• Fluency in Java/C++ with 8+ years of experience developing production-level software
• Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
• 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
• Hands-on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
• Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
• Passion for learning and delivering using latest technologies
• Ability to solve ambiguous, unexplored, and cross-team problems effectively
• Hands on experience of working projects on AWS, Azure, and Google Cloud Platform 
• Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud) 
• Understanding of distributed file systems such as  S3, ADLS, or HDFS
• Excellent communication skills and affinity for collaboration and teamwork
• Ability to work individually and collaboratively with other team members
• Ability to scope and plan solution for  big problems and mentors others on the same
• Interested and motivated to be part of a fast-moving startup with a fun and accomplished team