[ANN] Pimki 1.4

ruby-talk
1

Pimki 1.4.092 highights:
- Integrated Instiki 0.9.2 fixes and additions
- Todo@Context
- Edit on double-click
- Major/minor edits
- More customization options
- The inevitable bug fixes...

Cheers,
Assaph

** About

Pimki is my modified Instiki[1], aimed at being a Personal Information
Manager. Current version is based on latest Instiki (0.9.2).

There are some features added to Instiki, features that only make sense
when you view it as a personal application and not as a group oriented
application. Some Instiki features were suppressed. See below for a
full list.

Please feel free to try it to organize your thoughts, email me if you
have any problems (assaph at gmail). Get it at:

http://pimki.rubyforge.org/

** Features

Besides all the regular Instiki goodness, Pimki adds:

* Mind Map: a graph of wiki connections (made with GraphViz).
All graphs can be laid-out with the 4 GraphViz engines. Graph
contents can be arranged as:
o Page → linked pages
o Authors → pages
o Categories → pages
Requires that GraphViz be installed and on the PATH to be
enabled.
* Bliki: a blog integrated with the wiki. Blog entries are simply
wiki-pages in a special space. Can link from an entry to wiki
pages.
* Todo Items & List:
o ‘todo:’ items are highlighted on each page.
o Added a capacity to pull and list todo items from all
pages.
o On main list, items are highlighted & sorted according to date
(if there is one).
o Todo items can have (multiple) context and the display can be fltered
based on that context.
* Added capacity to delete & rename pages through
the ‘All Pages’ list.
* Added Left-Side Menu. Content options are:
o Only pages that reference other pages (default)
o All pages: by name
o All pages: recently revised
o All pages: recently visited
o All pages: most often visited
o User definable wiki-text
* Expanded Search:
o Search also tries to match the page names (not just
contents).
o Now showing part of sentence around match in search-results
page.
* Changed the nav-bar: added links to the Mind Map, Bliki and ToDo.
Moved less relevant links to the bottom of Home Page: RSS,
authors
and export.

** Installation

Download it from the RubyForge project page or go the gem way and
simply run:
gem install pimki

To enable the Mind Map feature, GraphViz[2] must be installed and the
bin directory on the system path.

Run it with the command 'pimki' or install it as a service (see home
page for details).

2

Hi Assaph,

···

On Sat, Jan 15, 2005 at 11:16:11PM +0900, Assaph Mehr wrote:

Pimki 1.4.092 highights:
- Integrated Instiki 0.9.2 fixes and additions
- Todo@Context
- Edit on double-click
- Major/minor edits
- More customization options
- The inevitable bug fixes...
[...]

   I've just downloaded Pimki 1.4 (the tgz, not gem or anything). I was using
1.2 and was pretty happy with it.

   I guessed that simply copying the "storage" directory from the old
"installation" would work, but it seems not. I can view content, but it seems
they're all old versions of the pages. Any idea?

   Regards,

--
Esteban Manchado Velázquez <zoso@foton.es> - http://www.foton.es
EuropeSwPatentFree - http://EuropeSwPatentFree.hispalinux.es

3

Copying the storage directory should work (specifically, the <port>
directory within the storage, e.g. 2500).

There should be two sets of files: snapshots and command_logs (which
are incremental changes from the latest snapshot). Make sure you got
all files.
Is it possible that you've grabbed an old directory? or that perhaps
the latest snapshot/command_log file was open by a running instance of
pimki when you copied and wasn't copied properly?

HTH,
Assaph

4

Hi Assaph,

   Thanks for the quick reply.

Copying the storage directory should work (specifically, the <port>
directory within the storage, e.g. 2500).

   Yes, I did just that.

There should be two sets of files: snapshots and command_logs (which
are incremental changes from the latest snapshot). Make sure you got
all files.

   After killing the pimki (1.2) process:

---------------------------------- 8< ----------------------------------
zoso@velutha:~/src/pimki-1.2.092$ ls -a storage/2500/
total 568
drwxr-xr-x 2 zoso zoso 4096 2005-01-16 22:05 ./
drwx------ 3 zoso zoso 4096 2004-12-10 22:12 ../
-rw-rw-rw- 1 zoso zoso 54683 2004-12-11 00:29 000000000000000000001.command_log
-rw-rw-rw- 1 zoso zoso 68619 2004-12-11 02:54 000000000000000000002.command_log
-rw-rw-rw- 1 zoso zoso 24469 2004-12-11 16:25 000000000000000000003.command_log
-rw-rw-rw- 1 zoso zoso 26770 2004-12-12 04:13 000000000000000000004.command_log
-rw-rw-rw- 1 zoso zoso 8490 2004-12-12 15:08 000000000000000000005.command_log
-rw-rw-rw- 1 zoso zoso 1560 2004-12-12 17:51 000000000000000000006.command_log
-rw-rw-rw- 1 zoso zoso 6614 2004-12-14 01:29 000000000000000000007.command_log
-rw-rw-rw- 1 zoso zoso 19183 2004-12-27 23:48 000000000000000000008.command_log
-rw-rw-rw- 1 zoso zoso 16432 2004-12-28 20:03 000000000000000000009.command_log
-rw-rw-rw- 1 zoso zoso 3240 2004-12-30 17:48 000000000000000000010.command_log
-rw-rw-rw- 1 zoso zoso 29954 2004-12-30 22:59 000000000000000000011.command_log
-rw-rw-rw- 1 zoso zoso 19824 2005-01-02 01:50 000000000000000000012.command_log
-rw-rw-rw- 1 zoso zoso 4951 2005-01-02 23:58 000000000000000000013.command_log
-rw-rw-rw- 1 zoso zoso 4951 2005-01-03 17:17 000000000000000000014.command_log
-rw-rw-rw- 1 zoso zoso 4951 2005-01-04 00:34 000000000000000000015.command_log
-rw-rw-rw- 1 zoso zoso 10203 2005-01-04 23:31 000000000000000000016.command_log
-rw-rw-rw- 1 zoso zoso 3399 2005-01-05 17:41 000000000000000000017.command_log
-rw-rw-rw- 1 zoso zoso 17606 2005-01-06 23:12 000000000000000000018.command_log
-rw-rw-rw- 1 zoso zoso 1552 2005-01-07 18:41 000000000000000000019.command_log
-rw-rw-rw- 1 zoso zoso 39066 2005-01-09 00:45 000000000000000000020.command_log
-rw-rw-rw- 1 zoso zoso 8484 2005-01-09 17:55 000000000000000000021.command_log
-rw-rw-rw- 1 zoso zoso 11344 2005-01-11 01:00 000000000000000000022.command_log
-rw-rw-rw- 1 zoso zoso 3467 2005-01-11 23:30 000000000000000000023.command_log
-rw-rw-rw- 1 zoso zoso 13513 2005-01-12 23:52 000000000000000000024.command_log
-rw-rw-rw- 1 zoso zoso 6934 2005-01-13 20:49 000000000000000000025.command_log
-rw-rw-rw- 1 zoso zoso 73348 2005-01-15 00:06 000000000000000000026.command_log
-rw-rw-rw- 1 zoso zoso 10284 2005-01-16 21:40 000000000000000000027.command_log
-rw-rw-rw- 1 zoso zoso 3184 2005-01-16 21:57 000000000000000000028.command_log
-rw-rw-rw- 1 zoso zoso 6571 2005-01-16 23:20 000000000000000000029.command_log
---------------------------------- >8 ----------------------------------

No snapshots? After that, I did:

---------------------------------- 8< ----------------------------------
zoso@velutha:~/src/pimki-1.4.092$ mv storage{,~}
zoso@velutha:~/src/pimki-1.4.092$ cp -a ../pimki-1.2.092/storage .
---------------------------------- >8 ----------------------------------

Is it possible that you've grabbed an old directory?

   Hmmm... I don't think so, I only have one pimki directory and no backups,
AFAIK...

or that perhaps
the latest snapshot/command_log file was open by a running instance of
pimki when you copied and wasn't copied properly?

   Yes, I thought that, but killed pimki, tried to copy again and didn't work
either :-? BTW, the HomePage version was from December 10th, and I have
updated almost daily for the last several weeks.

   Oh, and I forgot to say that I get some errors at startup, I don't know if
it can be related:

---------------------------------- 8< ----------------------------------
zoso@velutha:~/src/pimki-1.4.092$ ruby pimki.rb
#<LoadError: No such file to load -- rubygems>
pdfeTeX (Web2C 7.4.5) 3.14159-1.10b-2.1
kpathsea version 3.4.5
Copyright (C) 1997-2003 The NTS Team (eTeX)/Han The Thanh (pdfTeX).
Kpathsea is copyright (C) 1997-2003 Free Software Foundation, Inc.
There is NO warranty. Redistribution of this software is
covered by the terms of both the pdfeTeX copyright and
the GNU General Public License.
For more information about these matters, see the files
named COPYING and the pdfeTeX source.
Primary author of pdfeTeX: The NTS Team (eTeX)/Han The Thanh (pdfTeX).
Kpathsea written by Karl Berry and others.

[2005-01-16 23:26:41] INFO WEBrick 1.3.1
[2005-01-16 23:26:41] INFO ruby 1.8.2 (2004-12-23) [i386-linux]
[2005-01-16 23:26:41] INFO Your WEBrick server is now running on http://localhost:2500
/home/zoso/src/pimki-1.4.092/app/controllers/wiki.rb:4: warning: already initialized constant RenderedTodo
/home/zoso/src/pimki-1.4.092/app/controllers/wiki.rb:209: warning: already initialized constant FAR_FUTURE
/home/zoso/src/pimki-1.4.092/app/controllers/wiki.rb:210: warning: already initialized constant TODO_RE
---------------------------------- >8 ----------------------------------

Regards,

···

On Mon, Jan 17, 2005 at 08:11:08AM +0900, Assaph Mehr wrote:

--
Esteban Manchado Velázquez <zoso@foton.es> - http://www.foton.es
EuropeSwPatentFree - http://EuropeSwPatentFree.hispalinux.es

5

   After killing the pimki (1.2) process:

z...@velutha:~/src/pimki-1.2.092$ ls -a storage/2500/
total 568

[snip]

No snapshots? After that, I did:

Indeed strange. Has the process been running without interruptions for
several days? It should generate one snapshot per day (after each 24
hours of operation).

Looks like you have the inceremental command_logs, but it only picks up
the first, not all of them. I'll look into it.
Maybe someone who knows madeleine listens in and can help me with
pointers? much appreciated :slight_smile:

as for the errors - they're all OK.
- You don't have rubygems, so that's the first error message. It'll
pick the required libraries from the pimki/libraries directory.
- The pdf stuff is from pdflatex which is used in exporting.
- The last 3 errors are caused by somehow reloading the wiki.rb file
twice. I'll get rid of them as soon as I find where it's happening :slight_smile:
Cheers,
Assaph

6

I am getting this

Internal Server Error
undefined method `revisions' for "":WEBrick::HTTPUtils::FormData
WEBrick/1.3.1 (Ruby/1.8.2/2004-11-03) at localhost:2500

My storage directory contains both commands and snapshot files.

Any hints?

Thanks

···

On Mon, 17 Jan 2005 09:16:08 +0900, Assaph Mehr <assaph@gmail.com> wrote:

> After killing the pimki (1.2) process:
>
> z...@velutha:~/src/pimki-1.2.092$ ls -a storage/2500/
> total 568

[snip]

> No snapshots? After that, I did:

Indeed strange. Has the process been running without interruptions for
several days? It should generate one snapshot per day (after each 24
hours of operation).

Looks like you have the inceremental command_logs, but it only picks up
the first, not all of them. I'll look into it.
Maybe someone who knows madeleine listens in and can help me with
pointers? much appreciated :slight_smile:

as for the errors - they're all OK.
- You don't have rubygems, so that's the first error message. It'll
pick the required libraries from the pimki/libraries directory.
- The pdf stuff is from pdflatex which is used in exporting.
- The last 3 errors are caused by somehow reloading the wiki.rb file
twice. I'll get rid of them as soon as I find where it's happening :slight_smile:
Cheers,
Assaph

--
Eduardo Fernández Corrales

7

Hi Assaph,

[...]
> No snapshots? After that, I did:

Indeed strange. Has the process been running without interruptions for
several days? It should generate one snapshot per day (after each 24
hours of operation).

    Oooh... that's the problem, then, I guess :slight_smile: I only have it up and
running for hours. Is that a problem? Can I force a snapshot somehow, and get
the newer version working with the latest data?

Looks like you have the inceremental command_logs, but it only picks up
the first, not all of them. I'll look into it.
Maybe someone who knows madeleine listens in and can help me with
pointers? much appreciated :slight_smile:

    :-)

as for the errors - they're all OK.
[...]

    OK, thanks.

···

On Mon, Jan 17, 2005 at 09:16:08AM +0900, Assaph Mehr wrote:

--
Esteban Manchado Velázquez <zoso@foton.es> - http://www.foton.es
EuropeSwPatentFree - http://EuropeSwPatentFree.hispalinux.es

8

I only have it up and running for hours. Is that a problem?
Can I force a snapshot somehow, and get the newer version
working with the latest data?

You can change the time between snapshots. I will try to make this a
configurable property, but for the time being you can edit
pimki/libraries/madeleine_service.rb and change SNAPSHOT_INTERVAL to
each hour. You will need to restart Pimki.
I am not sure that this will help with the missing data though :frowning:

9

Internal Server Error
undefined method `revisions' for "":WEBrick::HTTPUtils::FormData
WEBrick/1.3.1 (Ruby/1.8.2/2004-11-03) at localhost:2500

What page were you trying to access?
(It's not a madeleine problem, but a template one)

Cheers,
Assaph

10

Internal Server Error
undefined method `revisions' for "":WEBrick::HTTPUtils::FormData
WEBrick/1.3.1 (Ruby/1.8.2/2004-11-03) at localhost:2500

What page were you trying to access?

My storage directory contains both commands and snapshot files.

This isn't the problem. The problem is in one of the template filles
(.rhtml) trying to access a wrong object.

/Assaph

11

Hi Assaph,

I am trying to get the homepage of one of my two wikis:

http://localhost:2500/wikiweblogpim/show/HomePage

I didn't mention in my previous mail that I am migrating from version 1.2.

The root page for the wiki shows ok, as does the other wiki.

I have tried accessing other page of the wiki (shows in the browser
history) but they all give the same error in that wiki.

Thanks in advance.

···

On Tue, 18 Jan 2005 07:06:06 +0900, Assaph Mehr <assaph@gmail.com> wrote:

> Internal Server Error
> undefined method `revisions' for "":WEBrick::HTTPUtils::FormData
> WEBrick/1.3.1 (Ruby/1.8.2/2004-11-03) at localhost:2500

What page were you trying to access?

> My storage directory contains both commands and snapshot files.

This isn't the problem. The problem is in one of the template filles
(.rhtml) trying to access a wrong object.

/Assaph

--
Eduardo Fernández Corrales

12

I changed SNAPSHOT_INTERVAL to one hour, copied the data and all of that,
and it seems to work fine.

   BTW, when I only had command logs, it seemed to lose revisions (in the
sense that should be more revisions available, but the available ones seem to
be right).

   Thank you, Assaph,

···

On Tue, Jan 18, 2005 at 06:31:07AM +0900, Assaph Mehr wrote:

> I only have it up and running for hours. Is that a problem?
> Can I force a snapshot somehow, and get the newer version
> working with the latest data?

You can change the time between snapshots. I will try to make this a
configurable property, but for the time being you can edit
pimki/libraries/madeleine_service.rb and change SNAPSHOT_INTERVAL to
each hour. You will need to restart Pimki.
I am not sure that this will help with the missing data though :frowning:

--
Esteban Manchado Velázquez <zoso@foton.es> - http://www.foton.es
EuropeSwPatentFree - http://EuropeSwPatentFree.hispalinux.es

13

   I changed SNAPSHOT_INTERVAL to one hour, copied the data and all

of that,

and it seems to work fine.

   BTW, when I only had command logs, it seemed to lose revisions (in

the

sense that should be more revisions available, but the available ones

seem to

be right).

   Thank you, Assaph,

Glad I could help. I'll make it a configurable property in the next
release (which should be this weekend :slight_smile:

Cheers,
Assaph

14

Esteban Manchado Velázquez wrote:

  I changed SNAPSHOT_INTERVAL to one hour, copied the data and all of that,
and it seems to work fine.

I've been fiddling with MadeleineService in Instiki - it is somewhat smarter now.
See http://dev.instiki.org/changeset/7 and http://dev.instiki.org/changeset/22

Madeleine people: please tell me if I'm doing something wrong in those changesets, especially the first one.
If not, maybe you should use that code as an example of what a real-life thread for snapshot taking should look like?

There still one potentially big story missing - namely, a signal handler for graceful shutdown. I expect there must be moments during snapshot-taking when that thread is in critical state (in the sense that killing it would result in snapshot corruption). But I haven't looked at that aspect seriously yet.

  BTW, when I only had command logs, it seemed to lose revisions (in the
sense that should be more revisions available, but the available ones seem to
be right).

  Thank you, Assaph,

There was a trivial bug in Instiki that does it, especially on a page that is edited many times by the same person. See http://dev.instiki.org/changeset/19

···

--
Best regards,

Alexey Verkhovsky

Ruby Forum: http://ruby-forum.org (moderator)
RForum: http://rforum.andreas-s.net (co-author)
Instiki: http://instiki.org (maintainer)

15

I've been fiddling with MadeleineService in Instiki - it is somewhat
smarter now.
See http://dev.instiki.org/changeset/7 and
http://dev.instiki.org/changeset/22

Madeleine people: please tell me if I'm doing something wrong in those
changesets, especially the first one.
If not, maybe you should use that code as an example of what a real-life
thread for snapshot taking should look like?

I guess that's me! :slight_smile:

The changesets look fine. We should probably add a method to Madeleine
to allow querying about status things like that, so you aren't forced to
check for files.

I think Instiki's snapshot management is the most complete we've seen so
far, we may even merge it into Madeleine itself.

There still one potentially big story missing - namely, a signal handler
for graceful shutdown. I expect there must be moments during
snapshot-taking when that thread is in critical state (in the sense that
killing it would result in snapshot corruption). But I haven't looked at
that aspect seriously yet.

Madeleine writes snapshots into a ".snapshot.tmp"-file, forces a disk
write and only after that renames it to ".snapshot". So killing it
during the write won't break anything.

/Anders

···

On 2005-01-19 Alexey Verkhovsky wrote:

--