Research Scientist Intern, Machine Learning Acceleration (PhD)
Meta

Job Info

The Meta Reality Labs Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today. The focus of our team is on computer graphics and displays with primary research on the efficient synthesis of high-quality images for AR/VR systems. Our current research areas include custom graphics hardware, rendering algorithms for AR/VR, such as ray casting and neural rendering, perceptual aware rendering, neural compression, and generative AI for 3D graphics.You will use your background in Machine Learning to enable efficient hardware acceleration of ML algorithms for Computer Vision and Image Processing in AR and VR devices. You will also have an unique opportunity to optimize production systems, as well as help future-proof our silicon and software by proactively understanding state of the art research and develop hardware or software solutions to mitigate inefficiencies. To be successful in this role, you should possess strong software development skills, familiarity with ML algorithms and framework/toolchains and hands-on experience in software and hardware co-design, especially in the context of ML.Our internships are twelve (12) to sixteen (16), or twenty-four (24) weeks long and we have various start dates throughout the year.

Research Scientist Intern, Machine Learning Acceleration (PhD) Responsibilities:

• Collaborate with computer architects, software, ML and silicon engineers, to map and optimize ML workloads on various backend targets including CPU's, DSP's and Deep Learning Accelerators.
• Perform ML algorithm, software, hardware co-design to achieve best energy and performance efficiency.
• Develop performant C/C++ kernels and optimize domain specific compilers to port industry standard ML libraries to custom hardware.
• Review SOTA research trends in hardware specific ML model optimizations and mapping.
• Evaluate and integrate promising techniques into shipping products.
• Run analysis/profiling, identify performance and power bottlenecks on the actual hardware, virtual platforms, simulators or emulators and provide feedback for optimizations across the stack.

Minimum Qualifications:

• Currently has, or is in the process of obtaining, a PhD degree in Computer Science, Electrical Engineering or related field.
• Experience with Python (or similar) scripting and exposure to ML frameworks like Pytorch/TF.
• Experience in software design and programming in C/C++.
• Understanding of computer architecture and performance implications.
• Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.

Preferred Qualifications:

• Intent to return to a degree-program after the completion of the internship.
• Experience with hardware acceleration on GPU's/CPU's/DSP's/custom-ASICs.
• Proven track record of achieving significant results, as demonstrated by first-authored publications at leading workshops or conferences in computer vision/machine learning (e.g., CVPR, ICCV, ECCV, NeurIPS, ICML) or computer architecture (e.g., ISCA, ASPLOS, MICRO, HPCA).
• Experience and understanding of classic ML, CV algorithms, DeepLearning algorithms like BERT, RNN, CNN and frameworks like Tensorflow/Pytorch.
• Familiarity with the state of art ML algorithm optimizations like Neural Architecture Search, quantization, pruning etc.
• Familiarity with Deep learning compilers like tensor-rt, XLA is a plus.
• Familiarity with high performance sw kernel development for customized ISA.
• Familiarity with code profiling and debug tools. Tools in the context of ML is a plus.
• Ability to read code, trace them, and code refactor.

About Meta: