Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Activity import - convert to apiv4 #32234

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

eileenmcnaughton
Copy link
Contributor

@eileenmcnaughton eileenmcnaughton commented Feb 27, 2025

Overview

Activity import - convert to apiv4

Before

Activity import uses apiv3

After

uses apiv4

Technical Details

all mappings are namespaced - ie activity.id target_contact.id - as this is a very flat import this is fairly simple (conceptually _

Comments

Copy link

civibot bot commented Feb 27, 2025

🤖 Thank you for contributing to CiviCRM! ❤️ We will need to test and review this PR. 👷

Introduction for new contributors...
  • If this is your first PR, an admin will greenlight automated testing with the command ok to test or add to whitelist.
  • A series of tests will automatically run. You can see the results at the bottom of this page (if there are any problems, it will include a link to see what went wrong).
  • A demo site will be built where anyone can try out a version of CiviCRM that includes your changes.
  • If this process needs to be repeated, an admin will issue the command test this please to rerun tests and build a new demo site.
  • Before this PR can be merged, it needs to be reviewed. Please keep in mind that reviewers are volunteers, and their response time can vary from a few hours to a few weeks depending on their availability and their knowledge of this particular part of CiviCRM.
  • A great way to speed up this process is to "trade reviews" with someone - find an open PR that you feel able to review, and leave a comment like "I'm reviewing this now, could you please review mine?" (include a link to yours). You don't have to wait for a response to get started (and you don't have to stop at one!) the more you review, the faster this process goes for everyone 😄
  • To ensure that you are credited properly in the final release notes, please add yourself to contributor-key.yml
  • For more information about contributing, see CONTRIBUTING.md.
Quick links for reviewers...

➡️ Online demo of this PR 🔗

@civibot civibot bot added the master label Feb 27, 2025
@eileenmcnaughton eileenmcnaughton force-pushed the mem_import branch 5 times, most recently from eeac864 to c3bfd84 Compare February 27, 2025 10:57
@colemanw
Copy link
Member

@eileenmcnaughton I just want to check about one thing here...
In SearchKit (and API4.get in general) the base entity is not namespaced. So a search for activities would simply select "subject", "activity_type_id", etc. And then every joined entity would get an alias-prefix, so if you join on a Contact AS contact_1, you'd select contact_1.display_name, etc.

Is there a reason not to do it that way in CiviImport?

@eileenmcnaughton
Copy link
Contributor Author

@colemanw no - I can do it that way - so it will be no namespace for activity but namespaces for the contacts.

Comment on lines +126 to +141
$fields['target_contact.id'] = $contactFields['id'];
$fields['target_contact.id']['entity'] = 'Contact';
$fields['target_contact.id']['match_rule'] = '*';
$fields['source_contact.id'] = $fields['target_contact.id'];
$fields['source_contact.id']['entity_instance'] = 'SourceContact';
$fields['source_contact.id']['title'] .= ' ' . ts('(match to source contact)');
$fields['target_contact.id']['title'] .= ' ' . ts('(match to target contact)');
unset($contactFields['id']);

$fields += $contactFields;
$fields['target_contact.external_identifier'] = $contactFields['external_identifier'];
$fields['target_contact.external_identifier']['title'] = $contactFields['external_identifier']['title'] . ' (target contact)';
$fields['source_contact.external_identifier'] = $contactFields['external_identifier'];
$fields['source_contact.external_identifier']['entity_instance'] = 'SourceContact';
$fields['source_contact.external_identifier']['title'] = $contactFields['external_identifier']['title'] . ' (source contact)';
unset($fields['external_identifier']);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In Api4 generally the these pseudo-fields end in _id. Not sure if important to keep that consistent here.

$field = new FieldSpec('source_contact_id', 'Activity', 'Integer');
$field->setTitle(ts('Source Contact'));
$field->setLabel(ts('Added by'));
$field->setColumnName('id');
$field->setDescription(ts('Contact who created this activity.'));
$field->setRequired($action === 'create');
$field->setFkEntity('Contact');
$field->setInputType('EntityRef');
$field->setSqlRenderer([__CLASS__, 'renderSqlForActivityContactIds']);
$spec->addFieldSpec($field);
$field = new FieldSpec('target_contact_id', 'Activity', 'Array');
$field->setTitle(ts('Target Contacts'));
$field->setLabel(ts('With Contacts'));
$field->setColumnName('id');
$field->setDescription(ts('Contacts involved in this activity.'));
$field->setFkEntity('Contact');
$field->setInputType('EntityRef');
$field->setInputAttrs(['multiple' => TRUE]);
$field->setSerialize(\CRM_Core_DAO::SERIALIZE_COMMA);
$field->setSqlRenderer([__CLASS__, 'renderSqlForActivityContactIds']);
$spec->addFieldSpec($field);
$field = new FieldSpec('assignee_contact_id', 'Activity', 'Array');
$field->setTitle(ts('Assignee Contacts'));
$field->setLabel(ts('Assigned to'));
$field->setColumnName('id');
$field->setDescription(ts('Contacts assigned to this activity.'));
$field->setFkEntity('Contact');
$field->setInputType('EntityRef');
$field->setInputAttrs(['multiple' => TRUE]);
$field->setSerialize(\CRM_Core_DAO::SERIALIZE_COMMA);
$field->setSqlRenderer([__CLASS__, 'renderSqlForActivityContactIds']);
$spec->addFieldSpec($field);

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@colemanw no - a feature of the importer is that it handles a mix of things on those fields - ids, names, labels, abbreviations with flexibility around case sensitivity. I know you won't like that :-) but it is not only because of legacy code - it really is the case that users are pretty sloppy with their thinking about the differences between those things

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants