Mirth Connect write to MongoDB

[SSpeer]

Hi All, I've done some searching and can't seem to find much good info so I thought I'd toss it here.

What is the gest way to connect an MC destination to MongoDB to write data? I'm looking to load Mongo collections with data from HL7 messages.

Struggling with how to get MC to play nicely with Mongo.

Thx!

[jonbartels]

Can you share what you have already tried?

I have not done this myself but I think the general process is:

• Load MongoDB drivers as a Resource
• Configure Mirth to recognize the Mongo drivers
• Use Javascript in a transformer or DB writer step to write to Mongo

Try the forums: https://forums.mirthproject.io/search?q=mongo&searchJSON=%7B%22keywords%22%3A%22mongo%22%7D

From GitHub I found your thread here, and this one from davut - #4954 . Davut is an active open-source developer, search his repos and maybe he shared his code.

[rjkroll]

You need to provide the errors or issues you are having running this code or else nobody will be able to understand what the issue is.

[SSpeer]

I understand @rjkroll, I was hoping there was some general direction for connectivity to Mongo and I'd figure it out from there because I love to pick stuff apart and fix it. Thx for the reminder that I need to provide more info. Here is the error that I'm getting when I run the above code:
Transformer error
ERROR MESSAGE: Error evaluating transformer
com.mirth.connect.server.MirthJavascriptTransformerException:
CHANNEL: MongoDB Test Conn
CONNECTOR: To MongoDB
SCRIPT SOURCE: TRANSFORMER
SOURCE CODE:
130:
131: // drop all the data in it
132: // collection.drop();
133: // logger.info('drop the collection?');
134:
135: collection.insertOne(doc);
136: logger.info('collection.insertOne');
137:
138: // get it (since it's the only one in there since we dropped the rest earlier on)
139: var myDoc = collection.find().first();
LINE NUMBER: 135
DETAILS: Wrapped com.mongodb.MongoCommandException: Command failed with error 352: 'Unsupported OP_QUERY command: insert. The client driver may require an upgrade. For more details see https://dochub.mongodb.org/core/legacy-opcode-removal' on server localhost:27017. The full response is { "ok" : 0.0, "errmsg" : "Unsupported OP_QUERY command: insert. The client driver may require an upgrade. For more details see https://dochub.mongodb.org/core/legacy-opcode-removal", "code" : 352, "codeName" : "UnsupportedOpQueryCommand" }
at 62043111-c259-42a4-903b-cfe92ed71c40_JavaScript_Filter_Transformer_2:135 (doTransform)
at 62043111-c259-42a4-903b-cfe92ed71c40_JavaScript_Filter_Transformer_2:169 (doScript)
at 62043111-c259-42a4-903b-cfe92ed71c40_JavaScript_Filter_Transformer_2:171
at com.mirth.connect.server.transformers.JavaScriptFilterTransformer$FilterTransformerTask.doCall(JavaScriptFilterTransformer.java:235)
at com.mirth.connect.server.transformers.JavaScriptFilterTransformer$FilterTransformerTask.doCall(JavaScriptFilterTransformer.java:187)
at com.mirth.connect.server.util.javascript.JavaScriptTask.call(JavaScriptTask.java:114)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: com.mongodb.MongoCommandException: Command failed with error 352: 'Unsupported OP_QUERY command: insert. The client driver may require an upgrade. For more details see https://dochub.mongodb.org/core/legacy-opcode-removal' on server localhost:27017. The full response is { "ok" : 0.0, "errmsg" : "Unsupported OP_QUERY command: insert. The client driver may require an upgrade. For more details see https://dochub.mongodb.org/core/legacy-opcode-removal", "code" : 352, "codeName" : "UnsupportedOpQueryCommand" }
at com.mongodb.connection.ProtocolHelper.getCommandFailureException(ProtocolHelper.java:115)
at com.mongodb.connection.WriteCommandProtocol.receiveMessage(WriteCommandProtocol.java:240)
at com.mongodb.connection.WriteCommandProtocol.execute(WriteCommandProtocol.java:104)
at com.mongodb.connection.InsertCommandProtocol.execute(InsertCommandProtocol.java:67)
at com.mongodb.connection.InsertCommandProtocol.execute(InsertCommandProtocol.java:37)
at com.mongodb.connection.DefaultServer$DefaultServerProtocolExecutor.execute(DefaultServer.java:159)
at com.mongodb.connection.DefaultServerConnection.executeProtocol(DefaultServerConnection.java:286)
at com.mongodb.connection.DefaultServerConnection.insertCommand(DefaultServerConnection.java:115)
at com.mongodb.operation.MixedBulkWriteOperation$Run$2.executeWriteCommandProtocol(MixedBulkWriteOperation.java:455)
at com.mongodb.operation.MixedBulkWriteOperation$Run$RunExecutor.execute(MixedBulkWriteOperation.java:646)
at com.mongodb.operation.MixedBulkWriteOperation$Run.execute(MixedBulkWriteOperation.java:401)
at com.mongodb.operation.MixedBulkWriteOperation$1.call(MixedBulkWriteOperation.java:179)
at com.mongodb.operation.MixedBulkWriteOperation$1.call(MixedBulkWriteOperation.java:168)
at com.mongodb.operation.OperationHelper.withConnectionSource(OperationHelper.java:230)
at com.mongodb.operation.OperationHelper.withConnection(OperationHelper.java:221)
at com.mongodb.operation.MixedBulkWriteOperation.execute(MixedBulkWriteOperation.java:168)
at com.mongodb.operation.MixedBulkWriteOperation.execute(MixedBulkWriteOperation.java:74)
at com.mongodb.Mongo.execute(Mongo.java:781)
at com.mongodb.Mongo$2.execute(Mongo.java:764)
at com.mongodb.MongoCollectionImpl.executeSingleWriteRequest(MongoCollectionImpl.java:515)
at com.mongodb.MongoCollectionImpl.insertOne(MongoCollectionImpl.java:306)
at com.mongodb.MongoCollectionImpl.insertOne(MongoCollectionImpl.java:297)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:138)
at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:226)
at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:1692)
at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:1013)
at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:109)
at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:412)
at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3578)
at org.mozilla.javascript.InterpretedFunction.exec(InterpretedFunction.java:121)
at com.mirth.connect.server.util.javascript.JavaScriptTask.executeScript(JavaScriptTask.java:151)
at com.mirth.connect.server.transformers.JavaScriptFilterTransformer$FilterTransformerTask.doCall(JavaScriptFilterTransformer.java:224)
... 6 more

Yes, I know that my solution is legacy as I found out from the above referenced URL which is why I was wondering what the community has found lately.

Thx to all!

[ab-mg-23]

Based on the details in that exception, you need to use a newer version of the MongoDB driver.

[rjkroll]

What version is your Mongo driver and server? If they are upgraded to the latest versions, some of the code I posted might be depreciated. This should work, though:

var MongoClient = Packages.com.mongodb.client.MongoClient;
var MongoClientURI = Packages.com.mongodb.MongoClientURI;


var uri = 'mongodb://username:password@host:port/database';


var mongoClient = new MongoClient(new MongoClientURI(uri));

mongoClient.connect(function(err) {
    if (err) {
        logger.error('Failed to connect to MongoDB: ' + err);
        return;
    }

    var db = mongoClient.getDatabase('database');
    var collection = db.getCollection('collectionName');


    var messageData = connectorMessage.getRawData();


    collection.insertOne(messageData, function(err, result) {
        if (err) {
            logger.error('Failed to insert data into MongoDB: ' + err);
        } else {
            logger.info('Data inserted successfully. ID: ' + result.getInsertedId());
        }
        mongoClient.close();
    });
});

• The MongoClient and MongoClientURI classes are imported from the com.mongodb.client package instead of the com.mongodb package.
• The getDatabase method is used to get the database object instead of getDB.
• The insertOne method is called directly on the collection object instead of using the deprecated insert method.

[SSpeer]

Coolio! I will play around a bit more with the info you provided and see what I can come up with. The current driver I'm using is:
mongodb-driver-3.2.2.jar

Will update and see if I can pull the white rabbit out of the hat.

Thx!

[rjkroll]

var MongoClient = Packages.com.mongodb.MongoClient;
var MongoClientURI = Packages.com.mongodb.MongoClientURI;

var uri = 'mongodb://username:password@host:port/database';

var mongoClient = new MongoClient(new MongoClientURI(uri));

mongoClient.connect(function(err) {
    if (err) {
        logger.error('Failed to connect to MongoDB: ' + err);
        return;
    }
    var db = mongoClient.getDB();
    var collection = db.getCollection('collectionName');

    var messageData = connectorMessage.getRawData();

    collection.insertOne(messageData, function(err, result) {
        if (err) {
            logger.error('Failed to insert data into MongoDB: ' + err);
        } else {
            logger.info('Data inserted successfully. ID: ' + result.getInsertedId());
        }
        mongoClient.close();
    });
});

[SSpeer]

Interesting... what are the custom dependencies? For a solution that I had, a few years back (pre-MC3.4), there were custom jar files for Mongo that I needed to reference in custom-lib. I tried, off the top of my head, to figure it out again but I am not successful. With all of the updates lately to MC I thought there may be some other fun and amazing ways to accomplish this.