2009-05-11

2009-05-11

michal frackowiak 11 May 2009 14:40

• Background page recompilation — when you save a page that is either included in other pages or other pages depend on - now they are all recompiled in a background process on the server, and do not keep you waiting for the result.
• This also applies to _template page edits that affect all pages in the category.
• This eliminates errors when saving a page that a lot of pages depend on. Also, "save" works much faster now.

---

Michał Frąckowiak @ Wikidot Inc.
Visit my blog at michalf.me

Re: 2009-05-11

WikiWealth 11 May 2009 21:45

I'm lovin it. Thank you guys!

---

WikiWealth.com - Stock, Fund, Commodity & Currency Research | SWOT Analysis, WACC

Re: 2009-05-11

(account deleted) 11 May 2009 23:41

If the matter come to

… "save" works much faster now

I very appreciate it … very nice update Michal!

Can you clarify a bit?

Ed Johnson 12 May 2009 10:52

This sounds like it's going to solve a lot of issues for a lot of large wikis, especially those with a large number of pages with a live template applied.

Can you explain in more detail? The reason I ask is that is that I applied a live template to a category that had just 4 pages so far. I found that I had to visit each page and do an edit/save to recompile the pages before I saw the results applied. If I would have waited some amount of time I assume edit/save would not have been necessary. Does your solution involve a regularly scheduled cron job? How often does the background process run?

Thanks,

-Ed

---

Free Wikidot Applications · Your Shared Photo Gallery · Your Personal Blog

Re: 2009-05-11

michal frackowiak 13 May 2009 11:55

Hi,

how the system works now is that when Wikidot saves a page, all the pages that depend on it are not recompiled instantly, but instead they are queued for recompilation. Only the current page is being recompiled.

At the same time we have a bunch (5 to 10, depending on the size of queue) background processes that fetch pages from the queue and recompile them.

I have been monitoring the queue and with the current setup it is "almost zero" — any bunch of pages are quite quickly processed.

What might however happen is that sometimes the queue is large and you might need to wait a while for all the pages to get recompiled. If however this takes more than a minute or two — there might be something wrong with the process. I will look into logs and statistics today to see if there were any bottlenecks.

---

Michał Frąckowiak @ Wikidot Inc.
Visit my blog at michalf.me

Re: 2009-05-11

cold_blood3d 15 May 2009 08:01

thanks again for this fix michal!

Re: 2009-05-11

gerdami 20 May 2009 10:48

Thanks.

---

gerdami - Visit Handbook en Français - Rate this howto:import-simple-excel-tables-into-wikidot up!