OVERVIEW: DATA ARCHIVING & VERSION CONTROL Pro j e ct Rev ie w 20 22 –
14 Slides5.33 MB
OVERVIEW: DATA ARCHIVING & VERSION CONTROL Pro j e ct Rev ie w 20 22 – M art i n Hen se l 15.12.2022
OUTLINE Archiving vs. Version Control Different kinds of Data Accessibility Version control systems Product Life Cycle Management solutions Options, so many options . O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 2
ARCHIVING VERSUS VERSION CONTROL Archiving Version Control Track how data changes over time. Backup the data, possibly on multiple locations (redundancy). Control accessibility (user access control). Timestamped (time of archivation/file creation) May reduce data size (compression) Track who changes the data (commiter). Define snapshots (commits). Acts as a time machine for data. Allow diverging timelines (branching). Allow converging timelines and provide ways to integrate changes from different timelines into one (merging). Can accomodate all data types. M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y - Best used for text data, most functionality not usable or not optimized for binary files. O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 3
e tiv C ol la bo ra DIFFERENT KINDS OF DATA Versioning Compiled applications Documentation images (png, pdf) Schematics Source Code, Scripts (py, cpp, hpp, .) Documentation text DRC/LVS definitions Board and wafer layouts Calibration data CAD files (3D construction data) Step files (finished 3D models) Human Readable Data Binary Data Measurement raw data (xls, xlsx, npy, hd5) Measurement raw data (csv, txt) Analyzed measurements (npy) ar et ri op Pr Communications (pdf) M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y Archiving y Generated plots (png, pdf) Communications (e.g. mails, chat) System/Client specifiactions O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 4
DATA ACCESSIBILITY Proprietary Data: Who can access? Wafer design files How to gain access? Technology related measurements How to transfer? Software & Firmware development Who can transfer? Collaborative Data: ASIC design/tests System specifications In between: Software releases PR plots/measurements Documentation M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 5
VERSION CONTROL SYSTEMS Human readable files: Industry standard Binary files: It‘s complicated We employ the industry standard: git Every binary file type is different. Other tools are available as well, e.g. SVN Data comparison almost impossible. The differences are mostly in administration style and where the data is stored. Most version control tools are proprietary and handle only a small subset of all possible binary data types. On top: Usablility User interface to work with the basic system A way for collaborators to interact with the data and each other Process automation (CI/CD) Documentation M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y E.g. Cadence Design Entry HDL: Version control of PCB schematics (HDL) via MS SharePoint server. - But no support for PCB layouts (boad files), although created with the same software suite. O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 6
PRODUCT LIFE CYCLE MANAGEMENT Many tools provide much more functionality: This sounds like a lot, but . Project planning and time tracking Work force deployment and load optimization it may be the only solution that encompasses a good chunck of a development task, e.g. PCB design from schematic, via simulation to layout. Manufacturing process tracking EDM integration (e.g. SAP orders from BOM) Management sugar: colorful plots about nothing it can be used as a common interface between several individual version control systems and bridge the gaps left by them. Issue tracking After-production: marketing, rollout Knowledge bases and documentation that may be true, it can be a total waste of time and manpower to manage such a system. Efficiency scoring (e.g. yield analysis) And many more M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 7
DISCLAIMER The following slides can only show a small part of the available products that can be used to perform the described tasks. The presented lists cannot – and are not intended to – be complete representations of the market. I have worked with some of the tools in the past. That introduces an inherent selection bias for some tools over others, based on previous experiences and ignorance about possibly superior alternatives and recent developments. M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 8
OPTIONS – FIRMWARE AND SOFTWARE For firmware and software development on git basis: Gitea Gitlab Stash (Atlassian) Location Self-hosted Hosted (GWDG) Hosted (tbd) Administration mhe vtravalja GWDG HLL Hoster HLL Repo Structure Organization, Project Group, Sub-group(s), Project Group, Project User Structure Organization, Team Group, Permission Group, Permission Issue tracking Integrated Integrated JIRA (Atlassian) Documentation Project wiki Group wiki, Project wiki Confluence (Atlassian) Automation Possible, but no experts available on site Implemented, runners on HLL machines TBD Implemented (bamboo), runner location TBD Collaboration Only internal GWDG members and external via guest account Everyone is external anyways Price tag Free ( mhe & vtravalja) Basic version free TBD M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 9
OPTIONS – 3D MODELING AND CAD Solidworks – Solidworks PDM Autodesk – Autodesk Vault Design workflows and automation steps (e.g. fill out drawing blocks with revision data). Manage revision and approval permissions and requirements. Document history and access to old versions. Check-out-check-in system to lock files. Branching and merging of designs for prototyping and experiments. But no coworking on the same file, no merging of changes from different users on the same file at the same time. https://www.solidworks.com/de/product/solidworks-pdm https://www.autodesk.com/products/vault/overview M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 10
OPTIONS – WAFER SCHEMATICS AND LAYOUTS ClioSoft SOS7 – Available from Europractice: Complete version tracking, branching and merging of design files. Check-in-check-out based editing: Lock the file you are working on so no other users can change it until your edits are done. Visual differences view to compare versions of layouts and schematics. Seamlessly integrates into Cadence Virtuoso and Library Manager and extends some functionalities like working on multiple files. Integrates into issue and bug tracking systems e.g. Atlassian JIRA. https://www.cliosoft.com/products/sos/ https://www.europractice.stfc.ac.uk/tools/cliosoft.html M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 11
OPTIONS – CADENCE PCB DESIGN SUITE PCB Schematics: PCB Layout: Footprints and Symbols: Allegro EDM Symphony Team Design Central Library Included in Europractice package 17.2 Available since 16.6 even better in 17.2 Has to be set up for our group with a central server instance. Server based or individual system. Open a session for several people to collaborate on the same layout. Check-out-check-in system to lock files, pages or hierarchy groups for editing. No direct version control. Revision tracking. Link for more information M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y Link for more information Work in progress by our new expert Sharif. Allegro Pulse Version control, product life cycle management Link for more Information O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 12
SO MANY OPTIONS – WHICH ONE TO TAKE? – DISCUSS! M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 13
THANK YOU FOR YOUR ATTENTION For questions please contact: Max Planck Society – Semiconductor Laboratory Martin Hensel Otto-Hahn-Ring 6 81739 München Tel.: 49 (0)89 839400-0 Fax: 49 (0)89 839400-11 E-Mail: [email protected] Internet: www.hll.mpg.de M A X P L A N C K S O C I E T Y S E M I C O N D U C T O R L A B O R AT O R Y O v e r v i e w : D a t a A r c h i v i n g & Ve r s i o n C o n t r o l – M a r t i n H e n s e l 1 5 . 1 2 . 2 0 2 2 14