====== Data Import Log ======


===== parse linux-sound.org =====

perl code used to do the job: {{:lad:data_dumps:la-apps-utils.tgz}} 

  cd ~/tmp/lao
  wget -m http://linux-sound.org
  tar xzf .../la-apps-utils.tgz
  # edit PATHS in perl script
  ./la-parse.pl 
  ./tagmerge.pl
  
  # resolve conflicts/ duplicates by hand
  cd /tmp/wiki/all &&   for dn in $(ls *-[0-9]*.txt | sed s/-[0-9]*\.txt$//g ); do \
    echo next-up: $dn;  read -n1 && vimdiff -o  $dn.txt $dn-*.txt ; done

  mv /tmp/wiki /tmp/apps
  tar czf /tmp apw.tgz -C /tmp apps

===== Merging Meta Information =====

generate intermediate files from [edited] dokuwiki-pages:

  cd ~/Sites/apps/data/pages/apps/all/
  grep -e "~~META:screenshot=..*~~" * > /tmp/screenshots.txt
  grep -e "~~META:logo=..*~~" * > /tmp/logos.txt
  grep -e "~~META:banner=..*~~" * > /tmp/banner.txt

apply intermediate files to [new] dokuwiki-pages:

  awk  '//{ i=index($0,":"); file = substr($0,0,i-1); val = substr($0,i+1); gsub("/", "\\/", val); \
   system("echo \"%s/~~META:banner=.*~~/" val "/g\nw\nq\" | ed all/" file); }' /tmp/banner.txt
  awk  '//{ i=index($0,":"); file = substr($0,0,i-1); val = substr($0,i+1); gsub("/", "\\/", val); \
   system("echo \"%s/~~META:screenshot=.*~~/" val "/g\nw\nq\" | ed all/" file); }' /tmp/screenshots.txt
  awk  '//{ i=index($0,":"); file = substr($0,0,i-1); val = substr($0,i+1); gsub("/", "\\/", val); \
   system("echo \"%s/~~META:logo=.*~~/" val "/g\nw\nq\" | ed all/" file); }' /tmp/logos.txt

fix permissions
  cd ~/Sites/apps
  find data -type f | xargs chmod a+rw
  find data -type d | xargs chmod a+rwx