Employer
Available with an access pass
The posting does not contain a country restriction that excludes Pakistan.
Confirm final eligibility and employment terms with the employer before applying.
About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. About the Role We are looking for a physics-focused professional to contribute to an advanced AI research initiative developing rigorous scientific coding tasks. The role combines physics expertise, Python-based scientific computing, and AI evaluation , requiring you to design complex scientific problems, implement verified solutions, and develop tests that assess the accuracy of AI-generated outputs. You will work on ensuring scientific correctness, determinism, and evaluation quality across structured STEM training tasks. Responsibilities Design scientific coding tasks consisting of one main physics problem and at least 3 logically connected sub-problems. Implement verified golden solutions in Python with complete unit test coverage. Develop discriminative test cases that distinguish correct from incorrect AI-generated outputs. Perform quality control checks using the Turing Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics. Revise scientific tasks and solutions based on QC feedback. Optimize tasks to meet Pass@K evaluation…
An access pass reveals the employer, complete posting, eligibility evidence, and official application link.