Skip to content

sugarcrmlabs/SystemData

Repository files navigation

Sugar Labs System Data

System Data is a tool built to simplify some of the data transferring tasks between environments of the same system.
The System Data tool helps you export and import some of the data available in Sugar using JSON data files.

THIS IS AN EXPERIMENTAL TOOL, USE AT YOUR OWN RISK! PLEASE DO CONTRIBUTE TO BUGFIXES!

Requirements

It requires Sugar version 8.0 or above.
It requires that the source and destinations systems are exactly the same in terms of code and customizations (including if changes are completed via Studio/Module Builder).
It requires the user to be an Admin

Features

Can export and import from one instance to another:

  • Teams
  • Roles
  • Users
  • Teams Membership
  • Roles Membership
  • Reports
  • SugarBPM

It can be used in three different ways:

  • Administration UI interfaces for exporting and importing
  • A set of API calls
  • A set of CLI commands

It respects Sugar Package Scanner.
It re-stores deleted records if necessary/found.
It deletes records if flagged accordingly on the JSON file.
It updates and creates records aligning them to the JSON files provided as input to the script.

It does NOT add fields/customisations for you. The assumption is that you already have the same exact code deployed on multiple instances, and you want to re-populate some of the data that lets you use a system.
It does NOT remove records that are on an instance, and that are not present on your JSON file(s).
It does NOT remove Users from Teams or Roles, it only adds Users to them.
It does NOT copy the user's pictures for you. You will have to transfer across the upload directory's content between systems BEFORE running the import script.

In more depth

Features

Teams

Only newly created Teams are transferred, no private or global Teams are exported

Roles

It exports both module level and field level. It does "smart update" of all field level security, aligning completely a Role to its newly deployed version.
It exports data from the database, converting actions/permissions into human readable format (eg: ACL_ALLOW_NORMAL, ACL_ALLOW_ENABLED, ACL_ALLOW_DEFAULT, ACL_ALLOW_OWNER and so on). This can give the flexibility of versioning Roles files and it is possible and really simple to update manually few elements within the JSON structure, to update the matching Roles accordingly.

Users

It includes Teams membership and Roles membership ONLY for explicit assignment. It includes reporting structure as well. It does not remove users from other explicit/implicit Teams membership or Role membeship. It includes also User Preferences, Dashboards and Filters.

Reports

It exports Reports, including all Teams and Team Sets used on the records. Now from 7.8 onwards there is an additional Team Set field for Team based ACL: acl_team_set_id and the script is already compatible with it.
In addition to export the Report records, it completes an export of the full list of Teams that comprise the related Team Sets. It also completes an export of the full list of Users that have a Private Team part of the Team Set (as private Teams are not exported by the tool, so that it can find the newly matching private Team for the same Users).

SugarBPM

It exports SugarBPM records, including business rules and email templates.
Some SugarBPM records required Teams and Team Sets. Similarly to the Reports export, the tool keeps track of what Teams and/or Users are related to the record.

Importing of Data

Please note that the order of import matters and it is really important.

The order should be:

  • Teams
  • Roles
  • Users
  • Teams Membership
  • Roles Membership
  • Reports
  • SugarBPM

This tool is only compatible with its own export files.

Installation

  • Clone the repository and enter the cloned directory
  • Retrieve the Sugar Module Packager dependency by running: composer install
  • Generate the installable .zip Sugar module with: ./vendor/bin/package 1.0
  • Install the generated module into the instance
  • Execute a repair and a hard browser refresh as an Administrator to see the UI
  • If on premise, and want to use the CLI, please make sure that <sugar directory>/bin/sugarcrm is executable

IMPORTANT: Make sure to keep the users's export file safe. User's passwords (even if hashed) are available on that file.

Testing

EXECUTING THE TESTING CLI IS DISRUPTIVE AND IT WILL WIPE YOUR DATABASE. Do not test the script with its own tools on any production like environment. To run the test command you actually have to type as agreement the argument i-agree-to-completely-delete-my-database

Contributing

Everyone is welcome to contribute to this project! If you make a contribution, then the Contributor Terms apply to your submission.

Please check out our Contribution Guidelines for helpful hints and tips that will make it easier for us to accept your pull requests.

Changelog

Changelog is available here


Copyright (c) 2019 SugarCRM Inc. Licensed by SugarCRM under the Apache 2.0 license.

About

System Data is a tool built to simplify some of the data transferring tasks between environments of the same system.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published