nyris is a high performance visual product search, object detection and visual recommendations engine for retail and industry applications. For more information please visit us at nyris.io.
This repo provides a C# SDK to use our system, including error handling, as well as reactive and asynchronous programming support. Specifically, we provide:
- Support for all nyris services,
- Support of Reactive/Asynchronous programming paradigms,
- Simplified error handling,
- Type-safe HTTP client, and a Unified response format.
To the following nyris services:
- Exact visual search,
- Visual similarity search,
- Object detection,
- Text search.
Please see the documentation at docs.nyris.io for a complete reference. At the minimum, the following criteria must be met:
- Images are sent in JPEG format,
- The minimum dimensions of an image are
512x512 px, and - The size of an image is less than or equal to
500 KB. - In Xamarin.Android or MAUI you need to make sure to handle the permissions and to include these permissions in
AndroidManifest.xml
<?xml version="1.0" encoding="utf-8"?>
<manifest xmlns:android="http://schemas.android.com/apk/res/android">
...
<uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" />
<uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE" />
<uses-permission android:name="android.permission.CAMERA" />
</manifest>- Get Started with nyris SDK
- Get Started with nyris Xamarin Searcher
- Get Started with nyris MAUI Searcher
- Getting an instance
- Match your first image
- Extract objects from your image
- Mark sent image as not found
- Text Match Search
First, initialize an instance of NyrisApi with your API Key :
static class Program
{
public static async Task Main(string[] args)
{
var apiKey = "Your Api Key"; // specify your nyris API key
var platform = Platform.Generic; // select your platform
var debugMode = true; // enable or disable debugging
var nyris = NyrisApi.CreateInstance(apiKey, platform, debugMode);
}
} byte[] imageByteArray = /*Your byte array*/;
//Asynchronous
var response = await nyris.ImageMatching.MatchAsync(image);
//Reactive
nyris.ImageMatching
.Match(image)
.Subscribe(response =>
{
Console.WriteLine(response);
},
throwable => Console.WriteLine(throwable.Message)
); //For more details about available feed attributes please check our documentation : http://docs.nyris.io/#available-feed-attributes.
var imageByteArray = ...; /* Your byte array */
nyris.ImageMatching
.Language("de") // Return only offers with language "de".
.Limt(10) // Limit returned offers
.CategoryPrediction(opt =>
{
opt.Enabled = true
opt.Threshold = 0.6f
opt.Limit = 10 //Size of the returned catgories
}) // Get predicted categories
.Filters(opt => // Add Filters
{
opt.AddFilter("color", new List<string> { "red", "blue" });
})
.Match(imageTestBytes)
.Subscribe(response =>
{
//Handle your response
var offers = response.Offers;
},
throwable => ...
);The response will be an object of type OfferResponseDto that contains list of Offers, RequestId
Extract objects from an image:
nyris.ObjectProposal
.ExtractObjects(image)
.Subscribe(response /* RegionsObjectDto */=>
{
// Handle your response
var objects = response;
}, throwable => ...);The returned response is a List of detected objects. Each object has:
Confidence; this is the probability of the top item with values ranging between:0-1.Regionis a bounding box. It represents the location and the size of the object in the sent image as a fraction of the image size.
It may happen that our service can't recognize or match an image. This is why we provide you a service to notify us about any unsuccessful matches.
Before you mark an image as "not successful", you will need to have the RequestId. For more details please check this section.
After getting the RequestId you can mark the image as not found.
nyris.Feedback
.MarkAsNotFound(RequestId)
.Subscribe(response /* HttpResponseMessage */=>
{
// Handle your response...
}, throwable => ...);nyris offers a service that helps you to search offers by text, SKU, barcode, etc. You can use the text search service the same way as the image matching service:
nyris.TextSearch
.Search("Your text")
.Subscribe(response =>
{
Console.WriteLine(response);
},
throwable => Console.WriteLine(throwable.Message)
);To start using image matching component, you will need to reference the project nyris.ui.Android for Android and the project nyris.ui.iOSfor iOS and include all the required dependencies with it.
- Starting the component
- Setting image matching options
- Handling returned results
- Handling JSON results
- Customizing the text of the component
- Customizing the color of the component
- Load last session state
To start the component call:
NyrisSearcher
.Builder("Your API Key Here", ActivityOrPresenterController)
.Start(...);For more details about image matching options please check this section.
NyrisSearcher
.Builder("Your API Key Here", ActivityOrPresenterController)
.Filters(opt => // Add Filters
{
opt.AddFilter("color", new List<string> { "red", "blue" });
})
.Start(...); NyrisSearcher
.Builder("Your API Key Here", ActivityOrPresenterController)
.CategoryPrediction(opt =>
{
opt.Enabled = true
opt.Threshold = 0.6f
opt.Limit = 10 //Size of the returned catgories
}) // Get predicted categories
.Filters(opt => // Add Filters
{
opt.AddFilter("color", new List<string> { "red", "blue" });
})
.Start(result => // Handling your result
{
if (result == null)
{
_tvResult.Text =
"the searcher is canceled or an exception is raised which forces the result to be null";
}
else
{
_tvResult.Text = $"Image Path = offerResponse.TakenImagePath \n" +
$"Found ({result.Offers.Count}) offers, with request id: {result.RequestCode})";
}
});The iOS version uses events to notify you about search result, first subscribe to OfferAvailable
searchService = NyrisSearcher,Builder("Your API Key Here", presenterController);
searchService.OfferAvailable += SearchServiceOnOfferAvailable;Whenever an search is performed SearchServiceOnOfferAvailable will be called:
void SearchServiceOnOfferAvailable(object sender, OfferResponseEventArgs e)
{
var offers = e.OfferResponse;
var json = e.OfferJson;
}Only one response type is available in OfferResponseEventArgs at a time. You can access the screenshot and the cropping frame by using :
void SearchServiceOnOfferAvailable(object sender, OfferResponseEventArgs e)
{
var screenshot = e.Screenshot;
var croppingFrame = e.Screenshot;
}You can change text of the component by using:
// You need to handle Camera and storage permissions before opening the nyris searcher
NyrisSearcher
.Builder("Your API Key Here", ActivityOrPresenterController)
.AgreeButtonTitle("My OK")
.CancelButtonTitle("My Cancel")
.CameraPermissionDeniedErrorMessage("You can not use this componenet until you activate the camera permission!")
.ExternalStoragePermissionDeniedErrorMessage("You can not use this componenet until you activate the access to external storage permission!")
.CameraPermissionRequestIfDeniedMessage("Your message when camera permission is denied") // For iOS only
.ConfigurationFailedErrorMessage("Your message when configuration is failed") // For iOS only
.CaptureLabelText("My Capture label.")
.DialogErrorTitle("Error Title")
.BackLabelText("Your back label") // For iOS only
.CategoryPrediction(opt =>
{
opt.Enabled = true
opt.Threshold = 0.6f
opt.Limit = 10 //Size of the returned catgories
}) // Get predicted categories
.Start();See NyrisSearcherConfig.cs for full list of configuration.
To customize the color of the component you will need to override the defined colors:
<?xml version="1.0" encoding="utf-8"?>
<resources>
<!-- You can override nyris searcher color here -->
<color name="nyris_color_primary">YOUR_COLOR</color>
<color name="nyris_color_primary_dark">YOUR_COLOR</color>
<color name="nyris_color_accent">YOUR_COLOR</color>
</resources>NyrisSearcher
.Theme(new AndroidThemeConfig
{
PrimaryColor = Color.Aqua,
PrimaryDarkColor = Color.DarkBlue,
AccentColor = Color.Salmon
})
...To customize the color or image of different views of the Searcher controller, create an instance of AppearanceConfiguration and assign it to the builder as follow:
var theme = new AppearanceConfiguration
{
CaptureLabelColor = UIColor.Red,
CropButtonTint = UIColor.Yellow,
BackButtonTint = UIColor.Red,
CaptureButtonTint = UIColor.Green,
CaptureButtonImage = UIImage,
CropButtonImage = UIImage,
FlashLightOffButtonImage = UIImage,
FlashLightOnButtonImage = UIImage,
};
searchService = NyrisSearcher
.Builder("Your API Key Here", this)
.Theme(theme)To load last session state of the NyrisSearcher you will need :
NyrisSearcher
.Builder("Your API Key Here", ActivityOrPresenterController)
.LoadLastState(true)
.Start(...);In case of an unknown error or un saved state the parameter will fallback to default mode.
Not different from Xamarin.Android SDK or Xamarin.iOS SDK, you can start using the nyris MAUI searcher by following this:
NyrisSearcher
.Builder("Your API Key Here", ActivityOrPresenterController)
.AgreeButtonTitle("My OK")
.CancelButtonTitle("My Cancel")
.CameraPermissionDeniedErrorMessage("You can not use this componenet until you activate the camera permission!")
.ExternalStoragePermissionDeniedErrorMessage("You can not use this componenet until you activate the access to external storage permission!")
.CameraPermissionRequestIfDeniedMessage("Your message when camera permission is denied") // For iOS only
.ConfigurationFailedErrorMessage("Your message when configuration is failed") // For iOS only
.CaptureLabelText("My Capture label.")
.DialogErrorTitle("Error Title")
.BackLabelText("Your back label") // For iOS only
.Language("de")
.Limit(10)
.CategoryPrediction(opt =>
{
opt.Enabled = true
opt.Threshold = 0.6f
opt.Limit = 10 //Size of the returned catgories
}) // Get predicted categories
.Start(result => // Handling your result
{
if (result == null)
{
// the searcher is canceled or an exception is raised which forces the result to be null
}
else
{
// Your result
}
};You can use the Theme method and the ThemeConfig object to change the tinting/color of the UI:
- PrimaryTintColor: For searcher UI elements tinting/coloring in light mode.
- PrimaryDarkTintColor: For searcher UI elements tinting/coloring in light mode (unsupported in iOS).
- AccentTintColor: For system UI elements (back button, status etc)
Here is an code example:
NyrisSearcher
.Builder("Your API Key Here", ActivityOrPresenterController)
.Theme(themeConfig =>
{
themeConfig.PrimaryTintColor = Colors.Red;
})
.Start( ... )If you want to change the capture and crop icon in the camera/crop view in iOS, please add an image to Resources/Images with the following name:
- nyris_custom_capture_icon.png
- nyris_custom_crop_icon.png.png
See the LICENSE file for the software license.