Register and share your invite link to earn from video plays and referrals.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
Joined May 2026
258 Following    219 Followers
# Learning Palantir Foundry ๐Ÿš€ Bring complex logic that no-code can't reach into your data platform, along with full software-engineering quality control. That's what Code Repositories delivers. ๐Ÿ“Œ Title and Feature URL Title: Code Repositories (Python Transforms) URL: ๐Ÿ“ Overview Code Repositories is a web-based integrated development environment (IDE) for creating and collaborating on production-ready code within Foundry. It provides a friendly UI over the underlying Git repositories, so teams can work without command-line access. With platform-specific features, you can apply software development practices directly to data engineering. ๐Ÿ”ง How It Works Version control and collaboration are at its core. - Common Git tasks (branching, committing, release tagging) execute through the web UI - Pull requests drive code review, with "highly configurable" permissions that support quality assurance such as mandatory reviews - IntelliSense, linting, error checking, and contextual help dialogs are available across all repository types - Transforms repositories let you author data transformation logic in Python, Java, or SQL with preview and debugging - Functions repositories natively integrate the Ontology and run low-latency business logic in TypeScript or Python ๐Ÿ›  Practical Usage - Use PySpark to implement billion-row entity resolution and complex business rules in code - Require PR reviews so a second reviewer and CI checks must pass before merge - Add unit tests to guard transform logic against regressions - In Functions repositories, leverage Ontology-data-type autocomplete to write logic safely - Bring machine learning workflows into the platform via model development repositories ๐ŸŽฏ Use Cases - Implementing complex reconciliation and business rules in PySpark that Pipeline Builder can't express - Structurally eliminating "regressions from editing production directly" through mandatory reviews and branch-based workflows - Implementing derived KPIs and validation logic as Functions reused across apps - Managing ML model training and inference code under governance โš ๏ธ Caveats - The docs note that Japanese translations are machine-generated and unverified, so localized content may have accuracy limitations - Each repository type (Transforms/Functions/Model) supports different languages and purposes, so pick the one that fits your goal - Being a pro-code environment, the quality benefits only materialize if your organization establishes review, CI, and test practices #PalantirFoundry# #DataEngineering#
Show more