electronic document storage system
We have had a meeting here from our quality department proposing that we take our documents to an electronic form. This will be done buy converting all of our paperwork for orders an stuff to pdf doc an storing them into some sort of database. I'm wondering of there is anything out there that will do this in linux an let me store it into a mysql database or something similar. Since I have our server here already on linux it would be nice to do it all on the linux side for at least the backend side of the stuff. Maybe even do the scanning in of the docs from a linux workstation would be even nicer. I have a pretty good ms access person here that know this will overload access an has come to me for a better database backend for what he is already doing in the quality department with there reports an stuff. I know squat about database so need some good info on setting up mysql. good books an tutoral would be nice. thanks in advance. jack malone Network Administrator EAST TEXAS LIGHTHOUSE FOR THE BLIND dba HORIZON INDUSTRIES 903-595-3444 http://www.horizonind.com
On Sat, 4 Oct 2003 05:47, Jack Malone wrote:
We have had a meeting here from our quality department proposing that we take our documents to an electronic form. This will be done buy converting all of our paperwork for orders an stuff to pdf doc an storing them into some sort of database. I'm wondering of there is anything out there that will do this in linux an let me store it into a mysql database or something similar. Since I have our server here already on linux it would be nice to do it all on the linux side for at least the backend side of the stuff. Maybe even do the scanning in of the docs from a linux workstation would be even nicer. I have a pretty good ms access person here that know this will overload access an has come to me for a better database backend for what he is already doing in the quality department with there reports an stuff. I know squat about database so need some good info on setting up mysql. good books an tutoral would be nice.
Have a look at DjVuLibre in lieu of PDF for storage. I believe it is far superior for document storage/retrevial and is based on an open standard. http://djvu.sourceforge.net/ http://www.djvuzone.org/ As for the database question, I will let others more qualified answer that. -- Regards, Graham Smith ---------------------------------------------------------
The 03.10.04 at 09:08, Graham Smith wrote:
Have a look at DjVuLibre in lieu of PDF for storage. I believe it is far superior for document storage/retrevial and is based on an open standard.
djvu (included on the distro) is certainly nice - once you already have the document in that format. It is, however, quite dificult to create them. -- Cheers, Carlos Robinson
On Fri, 2003-10-03 at 15:47, Jack Malone wrote:
We have had a meeting here from our quality department proposing that we take our documents to an electronic form. This will be done buy converting all of our paperwork for orders an stuff to pdf doc an storing them into some sort of database. I'm wondering of there is anything out there that will do this in linux an let me store it into a mysql database or something similar. Since I have our server here already on linux it would be nice to do it all on the linux side for at least the backend side of the stuff. Maybe even do the scanning in of the docs from a linux workstation would be even nicer. I have a pretty good ms access person here that know this will overload access an has come to me for a better database backend for what he is already doing in the quality department with there reports an stuff. I know squat about database so need some good info on setting up mysql. good books an tutoral would be nice.
thanks in advance.
jack malone Network Administrator EAST TEXAS LIGHTHOUSE FOR THE BLIND dba HORIZON INDUSTRIES 903-595-3444 http://www.horizonind.com Jack,
I don't have a Linux solution for you, but I have used imageWARE from Canon. It works very well for what you are describing. I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.) One thing I would recommend is NOT to store those pdfs inside a database. It is much better in my opinion to create a reasonble directory structure and save them there. Then use the database to store pointers to them as well any other data you need to keep. Greg
On Fri, 2003-10-03 at 16:13, Greg Freemyer wrote:
I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.)
Greg, I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!) Thanks, Tom -- Tom Nielsen Neuro Logic Systems 805.389.5435 x18 www.neuro-logic.com
On Friday 03 October 2003 19:39 pm, Tom Nielsen wrote:
On Fri, 2003-10-03 at 16:13, Greg Freemyer wrote:
I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.)
Greg,
I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!)
Thanks, Tom
I use the following script to make smaller pics. This uses imagemagik and its convert command: #!/bin/sh ######################################################################### # A simple script to create smaller and lower quality images from # one directory to another ######################################################################### # The file format you wish to change FROM=jpg # The end result file format TO=jpg # Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480' # Pull the directory name for the title FROM_DIR=/pictures/picdirectory TO_DIR=/home/userid/smallpics ######################################################################### # The actual conversion stuff # You can edit stuff below here to change how this works, or just stick # with the variables above (which should be good for most people ######################################################################### echo Running $0 echo COUNT=0 for i in `ls $FROM_DIR/*.$FROM | cut -d / -f 4`; do echo $1 if [ ! -e "$TO_DIR/$i" ] # Process only files not already done then echo Converting $i... with $CONVERT_OPTIONS convert $CONVERT_OPTIONS $FROM_DIR/$i $TO_DIR/$i echo fi done; exit; -- +----------------------------------------------------------------------------+ + Bruce S. Marshall bmarsh@bmarsh.com Bellaire, MI 10/03/03 20:58 + +----------------------------------------------------------------------------+ "In most advertisements, the time displayed on a watch is 10:10."
On Friday 03 October 2003 21:00, Bruce Marshall wrote:
On Friday 03 October 2003 19:39 pm, Tom Nielsen wrote:
On Fri, 2003-10-03 at 16:13, Greg Freemyer wrote:
I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.)
Greg,
I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!)
Thanks, Tom
I use the following script to make smaller pics. This uses imagemagik and its convert command:
#!/bin/sh
##################################################################### #### # A simple script to create smaller and lower quality images from # one directory to another ##################################################################### ####
# The file format you wish to change FROM=jpg
# The end result file format TO=jpg
# Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480'
# Pull the directory name for the title FROM_DIR=/pictures/picdirectory TO_DIR=/home/userid/smallpics
Bruce, Jumping in on this thread. Where does one put this script and/or call it in Image Magick? And, if I wanted to keep the files in the same directory by adding a "t" to it. (thumbnail) ?? Bob S.
On Fri, 2003-10-03 at 22:11, Bob S. wrote:
On Friday 03 October 2003 21:00, Bruce Marshall wrote:
On Friday 03 October 2003 19:39 pm, Tom Nielsen wrote:
On Fri, 2003-10-03 at 16:13, Greg Freemyer wrote:
I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.)
Greg,
I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!)
Thanks, Tom
I use the following script to make smaller pics. This uses imagemagik and its convert command:
#!/bin/sh
##################################################################### #### # A simple script to create smaller and lower quality images from # one directory to another ##################################################################### ####
# The file format you wish to change FROM=jpg
# The end result file format TO=jpg
# Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480'
# Pull the directory name for the title FROM_DIR=/pictures/picdirectory TO_DIR=/home/userid/smallpics
Bruce,
Jumping in on this thread. Where does one put this script and/or call it in Image Magick? And, if I wanted to keep the files in the same directory by adding a "t" to it. (thumbnail) ??
Bob S.
Ooooooh. Nice question. Bruce? - - - - - - - - - - - - - - - - - - Tom Nielsen Neuro Logic Systems, Inc. 805.389.5435 x18 www.neuro-logic.com
On Saturday 04 October 2003 1:11 am, Bob S. wrote:
On Friday 03 October 2003 21:00, Bruce Marshall wrote:
On Friday 03 October 2003 19:39 pm, Tom Nielsen wrote:
On Fri, 2003-10-03 at 16:13, Greg Freemyer wrote:
I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.)
Greg,
I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!)
Thanks, Tom
I use the following script to make smaller pics. This uses imagemagik and its convert command:
Here's a better version of the script I posted... with thanks to Anders for his changes. What I had worked for me but wasn't generic enough to be posted. I've tested the script below and it seems to work just fine. Make the appropriate changes to the directory paths and the JPG quality and geometry parameters. BTW, the convert command shown within is part of ImageMagick and nothing else needs to be done to run the script. I run it from an icon on the desktop. #!/bin/sh ######################################################################### # A simple script to create smaller and lower quality images from # one directory to another ######################################################################### # The file format you wish to change FROM=jpg # The end result file format TO=jpg # Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480' # Pull the directory name for the title FROM_DIR=/path_to_from_directory TO_DIR=/path_to_TO_directory ######################################################################### # The actual conversion stuff # You can edit stuff below here to change how this works, or just stick # with the variables above (which should be good for most people ######################################################################### echo Running $0 echo COUNT=0 cd $FROM_DIR for i in *.$FROM; do echo $1 if [ ! -e "$TO_DIR/$i" ] # Process only files not already done then echo Converting $i... with $CONVERT_OPTIONS convert $CONVERT_OPTIONS $FROM_DIR/$i $TO_DIR/${i%%$FROM}$TO echo fi done; exit; -- +----------------------------------------------------------------------------+ + Bruce S. Marshall bmarsh@bmarsh.com Bellaire, MI 10/04/03 12:56 + +----------------------------------------------------------------------------+ "What do you do when you see an endangered animal eating an endangered plant?"
It works!!! Soooo cooool. Thanks a bunch to Bruce and Anders!!!! Tom On Sat, 2003-10-04 at 10:01, Bruce Marshall wrote:
Here's a better version of the script I posted... with thanks to Anders for his changes. What I had worked for me but wasn't generic enough to be posted.
I've tested the script below and it seems to work just fine. Make the appropriate changes to the directory paths and the JPG quality and geometry parameters.
BTW, the convert command shown within is part of ImageMagick and nothing else needs to be done to run the script. I run it from an icon on the desktop.
#!/bin/sh
######################################################################### # A simple script to create smaller and lower quality images from # one directory to another #########################################################################
# The file format you wish to change FROM=jpg
# The end result file format TO=jpg
# Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480'
# Pull the directory name for the title FROM_DIR=/path_to_from_directory TO_DIR=/path_to_TO_directory
######################################################################### # The actual conversion stuff # You can edit stuff below here to change how this works, or just stick # with the variables above (which should be good for most people #########################################################################
echo Running $0 echo
COUNT=0
cd $FROM_DIR for i in *.$FROM; do
echo $1 if [ ! -e "$TO_DIR/$i" ] # Process only files not already done then echo Converting $i... with $CONVERT_OPTIONS convert $CONVERT_OPTIONS $FROM_DIR/$i $TO_DIR/${i%%$FROM}$TO echo fi
done;
exit;
- - - - - - - - - - - - - - - - - - Tom Nielsen Neuro Logic Systems, Inc. 805.389.5435 x18 www.neuro-logic.com
Thanks again to Bruce and Anders for the resizing script. It helps a ton! The only problem I have now is that I need to bring all my images to a certain place in order to resize them. A GUI would be great! This way folks can pick which directory/images they want to use, then pick one where the converted images are supposed to go. Resize options could exist as well as possible file name changes to distinguish the old from the new. I'd do it myself except for one thing....I don't know what the hell I'm doing! I'm a sales/marketing guy....I only think up these ideas. So, who wants to create the GUI???? Tom
Cool! Thanks! Tom On Fri, 2003-10-03 at 18:00, Bruce Marshall wrote:
On Friday 03 October 2003 19:39 pm, Tom Nielsen wrote:
On Fri, 2003-10-03 at 16:13, Greg Freemyer wrote:
I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.)
Greg,
I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!)
Thanks, Tom
I use the following script to make smaller pics. This uses imagemagik and its convert command:
#!/bin/sh
######################################################################### # A simple script to create smaller and lower quality images from # one directory to another #########################################################################
# The file format you wish to change FROM=jpg
# The end result file format TO=jpg
# Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480'
# Pull the directory name for the title FROM_DIR=/pictures/picdirectory TO_DIR=/home/userid/smallpics
######################################################################### # The actual conversion stuff # You can edit stuff below here to change how this works, or just stick # with the variables above (which should be good for most people #########################################################################
echo Running $0 echo
COUNT=0
for i in `ls $FROM_DIR/*.$FROM | cut -d / -f 4`; do
echo $1 if [ ! -e "$TO_DIR/$i" ] # Process only files not already done then echo Converting $i... with $CONVERT_OPTIONS convert $CONVERT_OPTIONS $FROM_DIR/$i $TO_DIR/$i echo fi
done;
exit;
-- +----------------------------------------------------------------------------+ + Bruce S. Marshall bmarsh@bmarsh.com Bellaire, MI 10/03/03 20:58 + +----------------------------------------------------------------------------+ "In most advertisements, the time displayed on a watch is 10:10."
- - - - - - - - - - - - - - - - - - Tom Nielsen Neuro Logic Systems, Inc. 805.389.5435 x18 www.neuro-logic.com
On Fri, 2003-10-03 at 18:00, Bruce Marshall wrote:
I use the following script to make smaller pics. This uses imagemagik and its convert command:
#!/bin/sh
######################################################################### # A simple script to create smaller and lower quality images from # one directory to another #########################################################################
# The file format you wish to change FROM=jpg
# The end result file format TO=jpg
# Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480'
# Pull the directory name for the title FROM_DIR=/pictures/picdirectory TO_DIR=/home/userid/smallpics
######################################################################### # The actual conversion stuff # You can edit stuff below here to change how this works, or just stick # with the variables above (which should be good for most people #########################################################################
echo Running $0 echo
COUNT=0
for i in `ls $FROM_DIR/*.$FROM | cut -d / -f 4`; do
echo $1 if [ ! -e "$TO_DIR/$i" ] # Process only files not already done then echo Converting $i... with $CONVERT_OPTIONS convert $CONVERT_OPTIONS $FROM_DIR/$i $TO_DIR/$i echo fi
done;
exit;
Problem Bruce. The directory of my pictures is /home/tom/Kids/*.JPG If I setup your script like this: # Pull the directory name for the title FROM_DIR=/home/tom/Kids/ TO_DIR=/home/tom/Kids/smaller I get this response: Converting Kids... with -quality 70 -geometry 640x480 convert: Unable to open file (/home/tom/Kids//Kids) [No such file or directory]. Please note the //Kids Now if I do this: /home/tom/Kids (notice no /) I get this: Converting Kids... with -quality 70 -geometry 640x480 convert: Unable to open file (/home/tom/Kids/Kids) [No such file or directory]. Notice the added /Kids? Did I do something wrong? I have the script in my /home/tom/Kids folder. I also tried to move it to a different folder. no luck. Thanks, Tom - - - - - - - - - - - - - - - - - - Tom Nielsen Neuro Logic Systems, Inc. 805.389.5435 x18 www.neuro-logic.com
On Saturday 04 October 2003 03.00, Bruce Marshall wrote:
#!/bin/sh
######################################################################### # A simple script to create smaller and lower quality images from # one directory to another #########################################################################
# The file format you wish to change FROM=jpg
# The end result file format TO=jpg
This is never used
# Options for "convert" CONVERT_OPTIONS='-quality 70 -geometry 640x480'
# Pull the directory name for the title FROM_DIR=/pictures/picdirectory TO_DIR=/home/userid/smallpics
######################################################################### # The actual conversion stuff # You can edit stuff below here to change how this works, or just stick # with the variables above (which should be good for most people #########################################################################
echo Running $0 echo
COUNT=0
for i in `ls $FROM_DIR/*.$FROM | cut -d / -f 4`;
This won't work in a generic way, the 4 can't be hard coded. something like cd $FROM_DIR for i in *.$FROM; do
do
echo $1 if [ ! -e "$TO_DIR/$i" ] # Process only files not already done then echo Converting $i... with $CONVERT_OPTIONS convert $CONVERT_OPTIONS $FROM_DIR/$i $TO_DIR/$i
Something like convert $CONVERT_OPTIONS $FROM_DIR/$i $TO_DIR/${i%%$FROM}$TO perhaps?
On Sat, 4 Oct 2003 09:39, Tom Nielsen wrote:
On Fri, 2003-10-03 at 16:13, Greg Freemyer wrote:
I have also manage 100K+ image files from digital cameras with a couple thousand new images a day being added. (we delete all images over 6-months old.)
Greg,
I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!)
Thanks, Tom
As I previously stated have a look at DjVu for storage of documents & pictures. A picture ends up 1/2 the size of a jpeg with the same or better resolution. It's on the SuSE CD's, so have a play. What is DjVu Many products and technologies are available today for storing and distributing digital images. However, most of these technologies are slow and inconvenient for distributing high-resolution color photos, and woefully impractical for delivering high-resolution scanned documents in B&W and color, because the files they produce are prohibitively large, and the viewing software memory hungry. With its ability to attain very high compression ratios while preserving crisp and legible text, DjVu has no rival when it comes to distributing scanned documents, particularly color documents. For this kind of applications, there is quite simply no practical alternative to DjVu. DjVu is also an excellent format for distributing high-resolution photos, because its wavelet-based continuous tone image compression technology produces small files with very fast progressive display, seamless zooming and panning, and requires minimal memory in the clie http://www.djvuzone.org/support/tutorial/chapter-intro.html -- Regards, Graham Smith ---------------------------------------------------------
On Sat, 2003-10-04 at 01:39, Tom Nielsen wrote:
Greg,
I have the typical "grandkids" page for my parents. What program can I use to resize jpg files in a batch process? Example: I went to Disneyland and took about 50 pics. I want to resize them from the 1280x1024 to 640x480 AND still keep the originals for selective printing and to put on a CD later. Right now I use Gimp and do them one by one. (Yucky!)
Thanks, Tom
I have a friend who runs website with a section like this. The images are also all from a digital camera, loaded into a directory on his server. the page that handles this is mostly php, and it calls (as far as I know) ImageMagic to do the resizing so it can display thumbnails. And it's quite quick too. Quicker, in fact, than to click on the images in konq and have kuickshow open them. Hans
Jack Malone wrote:
anything out there that will do this in linux an let me store it into a mysql database or something similar. Since I have our server here
You *could* put the PDFs (or whatever) into a MySQL database using one of the "blob" (binary) datatypes. http://www.mysql.com/documentation/mysql/bychapter/manual_Reference.html#BLO... *BUT* I'd seriously recommend you don't do that. Keep the document files as document files and simply put information about them into the database.
database so need some good info on setting up mysql. good books an tutoral would be nice.
You don't mention what kind of front end you envisage for this project, but if you'd like to use a web server based solution (everybody has a browser) I'd suggest this book .. http://tinyurl.com/poms (PHP and MySQL Web Development from Sams) .. which will tell you how to use MySQL and how to build a web based front and back end for it at the same time. sjb
participants (10)
-
Anders Johansson -
Bob S. -
Bruce Marshall -
Carlos E. R. -
Graham Smith -
Greg Freemyer -
H du Plooy -
Jack Malone -
sjb -
Tom Nielsen