Universal Content Puller XX Sources

Universal Content Puller XX Sources is a Content Sources extension for Universal Content Puller. The sources in this extension are XX because they are the kind of source you may not want to let just anyone loose with, hence a separate package so they don't have to be installed with less sensitive sources.

Once installed, you will have:

Site database - select data from the site's database.
Any database - select data from any configured database.
Site database with form - select data from the site's database with additional query parameters from an on-page form.
Any database with form - select data from any configured database with additional query parameters from an on-page form.
SQLite File Manager - Pull content from an SQLite database uploaded to the file manager.
SQLite File Manager With Form - Pull content from an SQLite database uploaded to the file manager using additional parameters from a form.
SQLite File Path - Pull content from an SQLite database system file.
SQLite File Path With Form - Pull content from an SQLite database system file using additional parameters from a form.

To upload an SQLite database to the file manager you will need to enable the file extension in the dashboard at Dashboard > Systen & Settings > Files > Allowed File Types.. This is usually ".db".

You can see a demonstration of the Site Database content source at Example - SQL Data and Site Database with Form at Example - SQL Data with Form.

These sources also make good a starting points for developing custom data sources with more complex database queries. Copy and rename the Site Database or Any Database source for your custom source and then code your more complex query into it.

SQL Extract Transforms

If you need to run a query on data, the SQL sources from Universal Cointent Puller XX Sources are the best solution.

However, data is not always available in a database source. For such situations, Universal Cointent Puller XX Sources also provides the transforms

SQL Extract - Extract and filter content from any tabular data using an SQL expression.
SQL Extract with Form - Extract and filter content from any tabular data using an SQL expression using additional parameters from a form.

The general process is to pull the content source and, if necessary, transform it into a table. This will typically involve a Pipeline transform so an SQL Extract or SQL Extract with Form transform can then follow.

These SQL Extract or SQL Extract with Form transforms work in a similar way to the equivalent SQL sources. Internally, they translate the tabular data into a temporary SQLite database, then run the configured query to extract from the data and pass it onwards to further transforms or to the content display.

Query expressions consequently use the SQLite syntax which has minor differences from MySQL.

Extension

Universal Content Puller is designed for extension. Content sources, transforms and displays follow a pluggable and extensible architecture for easy integration of further sources, transforms and displays from within UCP or provided by third party packages or your own application specific plugins.