Hi all, I am exploring using a Google image database ( https://storage.googleapis.com/openimages/web/index.html) to train a local YOLO/Darknet neural network. As it contains 1.9 million images, I obviously need to be selective about the things I want to train for. So I was looking at the suggested FiftyOne application (https://docs.voxel51.com/index.html). Looks promising. Except I cannot run it. I get an error that mongod (which I guess is a MongoDB access daemon) cannot be found. I recognize the name. But I have not used it. I searched on OBS to see if it is available. All I see are some user packages that are all failing. This surprised me as I would have thought MongoDB was a big thing in the Python world. And SUSE do support Python. My questions are: Is anyone using MongoDB on openSUSE, especially Tumbleweed? If so, where did you find it? I looked at building MongoDB and saw this odd requirement ( https://github.com/mongodb/mongo/blob/master/docs/building.md): "About 13 GB of free disk space for the core binaries (mongod, mongos, and mongo) and about 600 GB for the install-all target." A typo? They meant MB instead of GB? BTW, it is specifically mongod that FiftyOne complains about. There is no populated database when building and installing it. So what on earth can require 600GB? As an aside, I was just introduced to the Python 3.11 feature that does not like one to mix using zypper and pip. I prefer zypper as it maintains things as part of my regular updating. And so that method is enabled by default. The complaint is about an 'externally-managed-environment'. To be honest it makes sense. I have always wondered how mixing zypper and pip would work. My solution was to make a Python virtual environment for this. And that uses pip because FiftyOne seems only available via pip. TIA for any pointers. -- Roger Oberholtzer
Le 21/12/2023 à 09:49, Roger Oberholtzer a écrit :
Is anyone using MongoDB on openSUSE, especially Tumbleweed? If so, where did you find it?
I had a need of mongdb some weeks ago, for a special project and noticed that it's no more free/open source, so most distro discard it I had no time to search further jdd -- https://artdagio.fr
On Thu, Dec 21, 2023 at 12:01 PM jdd@dodin.org <jdd@dodin.org> wrote:
Le 21/12/2023 à 09:49, Roger Oberholtzer a écrit :
Is anyone using MongoDB on openSUSE, especially Tumbleweed? If so, where did you find it?
I had a need of mongdb some weeks ago, for a special project and noticed that it's no more free/open source, so most distro discard it
Looking at the MongoDB site, they offer a community edition, including support for SLES15. Source is available on github. So it appears open source. IANAL, so I cannot decide whether SSPL is free enough, information on their site says it is derived from GPL. Can you explain what exactly is not free there?
Le 21/12/2023 à 10:17, Andrei Borzenkov a écrit :
On Thu, Dec 21, 2023 at 12:01 PM jdd@dodin.org <jdd@dodin.org> wrote:
Le 21/12/2023 à 09:49, Roger Oberholtzer a écrit :
Is anyone using MongoDB on openSUSE, especially Tumbleweed? If so, where did you find it?
I had a need of mongdb some weeks ago, for a special project and noticed that it's no more free/open source, so most distro discard it
Looking at the MongoDB site, they offer a community edition, including support for SLES15. Source is available on github. So it appears open source. IANAL, so I cannot decide whether SSPL is free enough, information on their site says it is derived from GPL. Can you explain what exactly is not free there?
I can't, I just read it's discarded from debian and do not find it neither on openSUSE jdd -- https://artdagio.fr
On 12/21/23 04:28, jdd@dodin.org wrote:
Looking at the MongoDB site, they offer a community edition, including support for SLES15. Source is available on github. So it appears open source. IANAL, so I cannot decide whether SSPL is free enough, information on their site says it is derived from GPL. Can you explain what exactly is not free there?
I can't, I just read it's discarded from debian and do not find it neither on openSUSE
It has been a stepchild database for a while and a giant pain even on Arch. I needed it for eGroupware push notifications but it was has hit or miss on availability. It was pushed hard several years ago to try and drive interest, but I have yet to find many happy success stories. -- David C. Rankin, J.D.,P.E.
On Friday, 22 December 2023 08:35:51 ACDT David C. Rankin wrote:
On 12/21/23 04:28, jdd@dodin.org wrote:
Looking at the MongoDB site, they offer a community edition, including support for SLES15. Source is available on github. So it appears open source. IANAL, so I cannot decide whether SSPL is free enough, information on their site says it is derived from GPL. Can you explain what exactly is not free there?
I can't, I just read it's discarded from debian and do not find it neither on openSUSE
It has been a stepchild database for a while and a giant pain even on Arch. I needed it for eGroupware push notifications but it was has hit or miss on availability. It was pushed hard several years ago to try and drive interest, but I have yet to find many happy success stories.
It is used as the database (and is a dependency for) graylog (which can be anything from a free syslog receiver/analyser to a full SIEM), and I know that it is under active development and has repositories for Debian at least. A quick search and browse of their website soon turned up this: /https://www.mongodb.com/download-center/community/releases/[1] They have a Suse 15 x64 rpm available for download, and I'm pretty sure they also have a zypper repo you can add...yes, here: https://repo.mongodb.org/zypper/suse/15/mongodb-org/7.0/x86_64/[2] That would be the easiest way to get it installed and kept up-to-date... -- ============================================================================== ============================ Rodney Baker rodney.baker@outlook.com.au ============================================================================== ============================ -------- [1] https://www.mongodb.com/download-center/community/releases [2] https://repo.mongodb.org/zypper/suse/15/mongodb-org/7.0/x86_64/
On 12/21/23 23:53, Rodney Baker wrote:
It is used as the database (and is a dependency for) graylog (which can be anything from a free syslog receiver/analyser to a full SIEM), and I know that it is under active development and has repositories for Debian at least.
A quick search and browse of their website soon turned up this:
/https://www.mongodb.com/download-center/community/releases/ <https://www.mongodb.com/download-center/community/releases>
They have a Suse 15 x64 rpm available for download, and I'm pretty sure they also have a zypper repo you can add...yes, here:
https://repo.mongodb.org/zypper/suse/15/mongodb-org/7.0/x86_64/ <https://repo.mongodb.org/zypper/suse/15/mongodb-org/7.0/x86_64/>
Packman has it. The issues I had with it as a dependency -- is it may or may not remain available. The AUR package published by polarean just went away, leaving all packages that depend on it in a lurch. openSUSE doesn't package it for the same reasons Arch doesn't package it and why it is in Packman and AUR. Given my experience with it, I always wondered why anyone would make it a dependency when MariaDB, PostgreSQL, DB or SQLite would suffice and not have the same issues. There is nothing wrong with mongodb itself, it's just the licensing and availability baggage that I see as a drawback. -- David C. Rankin, J.D.,P.E.
On Fri, Dec 22, 2023 at 6:54 AM Rodney Baker <rodney.baker@outlook.com.au> wrote:
https://repo.mongodb.org/zypper/suse/15/mongodb-org/7.0/x86_64/
That would be the easiest way to get it installed and kept up-to-date...
I had not seen that. I added the repo. When I tried to install things, I get: Error: INVALID:mongodb-database-tools-100.9.4-1.x86_64 (MongoDB): Signature verification failed [4-Signatures public key is not available] Header V4 RSA/SHA256 Signature, key ID 160d26bb1785ba38: NOKEY Header SHA256 digest: OK Header SHA1 digest: OK Payload SHA256 digest: OK MD5 digest: OK I have ignored them and done the install. Life on the edge... As I suspected, the blurb on the MongoDB site that said the full install was 600GB should really be 600MB as that is what was installed. Still, that seems large. Now to see if I can run FiftyOne and get access to the Google image source. -- Roger Oberholtzer
On Fri, Dec 22, 2023 at 7:40 AM Roger Oberholtzer < roger.oberholtzer@gmail.com> wrote:
On Fri, Dec 22, 2023 at 6:54 AM Rodney Baker <rodney.baker@outlook.com.au> wrote:
https://repo.mongodb.org/zypper/suse/15/mongodb-org/7.0/x86_64/
That would be the easiest way to get it installed and kept up-to-date...
I can report that the RPMs in this link seem to work on Tumbleweed. Or at least FiftyOne now runs - after telling it that mongod is in /usr/bin and not some FiftyOne directory. So I can now explore the Google Annotated image database. Now to figure out how to get the images and their annotations in a way that Darknet/YOLO wants when training a neural network... Thanks to Rodney for finding that repo. Maybe time to update https://en.opensuse.org/MongoDB -- Roger Oberholtzer
W dniu 21.12.2023 o 10:17, Andrei Borzenkov pisze:
On Thu, Dec 21, 2023 at 12:01 PM jdd@dodin.org <jdd@dodin.org> wrote:
Le 21/12/2023 à 09:49, Roger Oberholtzer a écrit :
Is anyone using MongoDB on openSUSE, especially Tumbleweed? If so, where did you find it?
I had a need of mongdb some weeks ago, for a special project and noticed that it's no more free/open source, so most distro discard it
Looking at the MongoDB site, they offer a community edition, including support for SLES15. Source is available on github. So it appears open source. IANAL, so I cannot decide whether SSPL is free enough, information on their site says it is derived from GPL. Can you explain what exactly is not free there?
On 12/21/23 03:49, Roger Oberholtzer wrote:
Is anyone using MongoDB on openSUSE, especially Tumbleweed? If so, where did you find it?
I use it in the Ubiquiti controller for my Unifi access point. I got it from here: https://build.opensuse.org/projects/home:hgraeber/packages/mongodb/repositor...
On Thu, Dec 21, 2023 at 4:50 PM James Knott <james.knott@jknott.net> wrote:
I use it in the Ubiquiti controller for my Unifi access point. I got it from here:
https://build.opensuse.org/projects/home:hgraeber/packages/mongodb/repositor... This is a very old version still under AGPL license and for sure it is not getting any updates or security patches. It is not exposed in any way maybe you are still fine. Last AGPL licensed one was 4.1.4 if I am not mistaken.
On 12/21/23 09:53, Stratos Zolotas wrote:
On Thu, Dec 21, 2023 at 4:50 PM James Knott <james.knott@jknott.net> wrote:
I use it in the Ubiquiti controller for my Unifi access point. I got it from here:
https://build.opensuse.org/projects/home:hgraeber/packages/mongodb/repositor...
This is a very old version still under AGPL license and for sure it is not getting any updates or security patches. It is not exposed in any way maybe you are still fine. Last AGPL licensed one was 4.1.4 if I am not mistaken.
It's used only on my desktop computer and behind 2 firewalls, the one on my computer and also my firewall/router.
On Thu, Dec 21, 2023 at 2:34 PM James Knott <james.knott@jknott.net> wrote:
On 12/21/23 03:49, Roger Oberholtzer wrote:
Is anyone using MongoDB on openSUSE, especially Tumbleweed? If so, where did you find it?
I use it in the Ubiquiti controller for my Unifi access point. I got it from here:
https://build.opensuse.org/projects/home:hgraeber/packages/mongodb/repositor...
This is one of the user builds I mentioned. But it is failing for Tumbleweed. I might try the 15.5 version. It is only for accessing these remote images. So I will not have the DB daemon running very often. -- Roger Oberholtzer
participants (8)
-
Adam Mizerski -
Andrei Borzenkov -
David C. Rankin -
James Knott -
jdd＠dodin.org -
Rodney Baker -
Roger Oberholtzer -
Stratos Zolotas