Topic: Concatenate 400 files (Page 1 of 1)

I downloaded 409 html files using an offline browser.
I would now like to concatenate all 400 files into 1 file, stripping away all the html and other tags in the process.
Is there one utility that can do that.
If not, is there a good utility to concatenate the html files and another one to convert them all into 1 giant text file?
Thanks

I'll keep googling.

Nature & Travel Photography
Visit the Sleeping Wolves

edit: ok, i found 2 freeware utilities that did the conversion and concat very nicely.
now, anyone know a good freeware to remove extra whitespace/blank lines?


(Edited by SleepingWolf on 11-03-2007 21:22)

You could make a macro in your text editor of choice

I'm guessing this in in Windows... In the command line, make sure you are at where the files are, and then type:

type *.html > everything.html

Then use a text editor with a regular expression or wildcard search and replace to remove all the HTML tags. Or, you can just view it in your browser, select all, copy, and paste in text editor.

Hope that helps!

I've done the conversion to text, and the concatenation to 1 big text file.
I now need to strip out excess blank lines...found a utility called tab.exe but it doesn't work properly with this file.
I also wrote a vba program in excel but for some reason excel is adding "quotes" to some lines at random when i save to text..problem is i have no way to know which lines need the quotes and which ones don't....so I can't search and replace - the file has over 30,000 lines including the extra white space. The excel program was also required because I need to sort the text using a divider to let me know the start and end of each poem (it's a huge collection of my mom's poems)

Nature & Travel Photography
Visit the Sleeping Wolves

(Edited by SleepingWolf on 11-03-2007 23:28)

I think this should work. CMD:

findstr /x ^. oldfile.txt > newfile.txt

(Edited by zavaboy on 11-03-2007 23:39)

(Edited by zavaboy on 11-03-2007 23:41)

/me cringes, then hugs his Unix commandline

I tried using Textpad with regular expressions (\n) and MS Word looking for ^p^p.
Both worked, but with some quirks. So I ended up writing a program in vba.

For the record, these 2 freeware utilities were excellent:

Simple File Joiner (look for the freeware version)

HtmlAsText.exe - did a clean job of removing scripts as well.

HTTrack was used for the offline browsing.

Nature & Travel Photography
Visit the Sleeping Wolves

cool post, thanks for sharing.

--
Regards,
Elias