AZBox OpenTools

Status
Not open for further replies.

tani1

Staff member
Super Moderator
Messages
17,767
AZOpen - AZBox OpenTools
This program downloads XMLTV data from rytec.be, and uses the control
files there to assist with the application of these data to the EPG of
the AZBox.

For users:
=========
If you just want to use this to set your EPG, copy the contents of the bin
directory onto your AZBox, and set up a cron job to execute it perhaps once
per day - select a weird time, to ensure that you don't overload the
rytec.be server.

Edit the azepgmgr.conf file to enable the channels you want. The default
is for the UK channels to be enabled, but you only have to remove the
comment character "#" from the line you want, in order to enable it.
Remember to comment out the UK entry if you don't want that.

Run azepgmgr.sh to run the tool. It's not fast, but it should finidh in
about 5 minutes. It tries to download the daily file form rytec.be, but
if it hasn't been made available yet, you can specify the date yourself
by calling it as:
./azepgmgr.sh YYYYMMDD
where YYYY=year, MM=month and DD=day, e.g. today is March 7, 2010, which
would be:
./azepgmgr.sh 20100307

Of course, you don't want to download the XMLTV data every time you want to
update your EPG. In this case, simply run:
./runazepg.sh
and this will update your EPG.

Actually, the program that does the EPG update is called azepgmgr and has
the following parameters:
-c ChannelsFile Default = "rytec.channels.xml"
The name of the file containing the channels information
-x XMLTVData Required - no default
The name of the file containing the XMLTV data
-d days Default = 1 day (24 hours)
The number of days for which to load the EPG
-h hours Default = 24 hours
The number of hours for which to load the EPG (see -d)
-n maxEvents Default = 10000
The number of events to load into the EPG
-v
Indicates that this should provide verbose information about the
run. If you specify more "-v"s, you get more debug information.

A typical run would be:
./azepgmgr -c rytec.channels.xml -x rytecxmltvuk

For developers:
===============
Requirements to build this are:
1. The AZBox TV SDK
2. The AZBox Plugin SDK (optional)
3. The AZBox toolchain

The program uses libxml2 to process the XMLTV data, so the versions of
these libraries rebuilt for the AZBox are in the bin directory, along
with the header files in the hdr directory.

There are a number of source files in the program:
main.c This contains main() and controls the run, reading the
command-line parameters.
dump.c Used for debugging and to dump various items
loadchan.c Reads the channel.xml file, using the data to identify
the corresponding channel in the AZBox's channel list.
loadepg.c Reads the EPG XMLTV data and calls the functions to
insert the data into the EPG.
sdkmgr.c Calls the SDK functions. This allows all other functions
to be tested in isolation of the SDK.

Known problems:
==============
* Because of memory limitations, this only supports the addition of a
maximum of around 10000 events.
* The AZBox SDK displays spurious messages: this is not a function of
this tool, but rather a function of the SDK.

History:
========
0.2 - 2010-03-12
This has useful defaults for the number of events and other params,
and introduces new command-line flags to allow the specification of
the duration in days or hours, and the maximum number of events

0.1 - 2010-03-11
Initial release
 

juli13

Staff member
Administrator
Messages
10,198
AZBox OpenTools v.03

Code:
[B]Lastest changes   [/B]

   The defaults for the number of days has been set to 5 days.
         Fixed a bug with the loading of texts where the data overwrote other
         fields. This now allows the number of events to exceed 50000.
         Added signal traps - ctrl-C and a segmentation fault are caught to
         allow the program clean up
         Improved logging - user -v multiple times to get mroe information

thx bpmurray
 

tani1

Staff member
Super Moderator
Messages
17,767
AZBox OpenTools v.04
Changes V0.4:
- Corrected the GMT offset: values are now subtracted instead of being incorrectly added.
- Hard-coded the date of 2010-03-05 for the sources file since rytec has not updated it recently.
 

juli13

Staff member
Administrator
Messages
10,198
AZBox OpenTools 0.5

0.5 - 2010-03-17

- Rationalised the executable calls to try to remove confusion
- Added more defaults to the parameters
- Cleansed downloaded XML data
- Fixed the bug where selecting multiple bouquets caused the EPG to
be overwritten by the events from the bouquet loaded last.
- Persisted the current EPG to assist with planned performance
enhancements.
- Created a new faster reload function
 

Doctor Who

Registered
Messages
81
AZOpen - AZBox OpenTools v 0.6

This describes the changes made for each version. For details on hoe
to use the program, see the README file in the executables directory.
For details about development of the program, see the README file in
the source directory.

Known problems:
==============
* The AZBox SDK displays spurious messages: this is not a function of
this tool, but rather a function of the SDK.
* It's slow, taking up to 90mins to load a full set of EPG data.
* The reloader does not exit cleanly

History:
========
0.6 - 2010-03-19
- Cleaned up the reloader and it runs *much* faster than the
initial load.
- Corrected behaviour if too many -v parameters are supplied.
- Added some information to the bin/README file.
- Fixed some time calulations.

0.5 - 2010-03-17
- Rationalised the executable calls to try to remove confusion
- Added more defaults to the parameters
- Cleansed downloaded XML data
- Fixed the bug where selecting multiple bouquets caused the EPG to
be overwritten by the events from the bouquet loaded last.
- Persisted the current EPG to assist with planned performance
enhancements.
- Created a new faster reload function

0.4 - 2010-03-15
- Corrected the GMT offset: values are now subtracted instead of being
incorrectly added.
- Hard-coded the date of 2010-03-05 for the sources file since rytec
has not updated it recently.

0.3 - 2010-03-14
- The defaults for the number of days has been set to 5 days.
- Fixed a bug with the loading of texts where the data overwrote other
fields. This now allows the number of events to exceed 50000.
- Added signal traps - ctrl-C and a segmentation fault are caught to
allow the program clean up
- Improved logging - user -v multiple times to get mroe information

0.2 - 2010-03-11
- This has useful defaults for the number of events and other params,
and introduces new command-line flags to allow the specification of
the duration in days or hours, and the maximum number of events

0.1 - 2010-03-12
- Initial release.


DOWNLOAD

AzEgMgr v 0.6

AzEgMgr src v 0.6
 

Doctor Who

Registered
Messages
81
AZOpen - AZBox OpenTools v 0.7

v 0.7 - 2010-03-19

* Speeded the whole thing up: it now downloads the data and generates the data file in about 4 minutes. The load phase then takes about 15 minutes.
* Fixed the problem with segmentation faults at the end.

Download

AzEpgMgr

AzEpgMgr src
 

tani1

Staff member
Super Moderator
Messages
17,767
AZBox OpenTools v.1.0
Changes V1.0:
- Mapped the speed updates to the main program, by inserting up to 25 events at a time. Inserting 50000 events takes about 20 minutes. I don't think this can be improved much, since this is a function of the SDK.
- Provided new command-line switches
 

juli13

Staff member
Administrator
Messages
10,198
AZBox OpenTools 1.0a

2010-03-22


- Minor change
- Automatically retrieve the correct version of the rytec sources
file. (Thanks to rcranium for the solution.)
 

elgeneral

Registered
Messages
7,811
version 1.1

2010-03-25


- Enable reboot and wakeup repopulation of the EPG.
- Created two scripts to reload the EPG at reboot and at wakeup
- Increased the memory usage to 20MB (that's the maximum).
 

elgeneral

Registered
Messages
7,811
version 1.2 28-03-2010

  • Bug fixes and auto-download
  • Fixed a bug with daylight savings time
  • Automatically download the XML if required
  • Changed default to values that definitely work
  • Hide the noise messages
 

elgeneral

Registered
Messages
7,811
version 1.3

2010-04-01

- Bug fixes
- Fixed up time settings, responding correctly to daylight savings
time
- Responded to the issues with the spurious messages by removing
the filter.
- Made a number of changes to optimise the behaviour
 

elgeneral

Registered
Messages
7,811
Version 1.4 - 2010-04-07

- Fixes and renames
- Hopefully resolved issues caused by daylight savings time.
- Renamed the executable to avoid all these problems reported by
folk not RTFM.
- Removed references to reloadepg since this has been superceded by
changes in _azepgmgr.
- Allow the system to identify the curretn DST settings, or to specify
DST as a flag (-t)
 

juli13

Staff member
Administrator
Messages
10,198
AZOpen - AZBox OpenTools 1.5

Code:
     Enhancementsw
         - Added support for multiple XMLTV data files which are concatenated
           to produce one big data file.
         - Added new param (-m size) that limits the length of the text that's
           inserted into the program description. The defalt is 4096, and any
           invalid value outside the range 0-4096 will be changed to 4096.
 

tani1

Staff member
Super Moderator
Messages
17,767
AZBox OpenTools version 1.5a - 2010-04-09
Changes V1.5a:
- Fix bugs in enhancements!
- Corrected well-formedness of the generated concatenated XML data
- Fixed shell programming of multiple files in a lis
- Changed getChannels signature to use a 16-bit nid (thanks Massimo!).
 

tani1

Staff member
Super Moderator
Messages
17,767
AZBox OpenTools v.1.6
Known issues:
=============
* Errors occur when committing data to the EPG - I don't know why these
happen, so need help from the dev folk. The effect is that when you
try to load the full EPG list, it loses a lot of the information.
* Some of the EPG data are not loaded - it appears that the channels are
not identified correctly. Perhaps the rytec information is inaccurate.

History:
========
1.6 - 2010-05-16 - Massimo - Fix bugs and enhancements!
- First of all I'd like to say Thank You to BPMURRAY for having started
this job and now I'm happy to help him to enhance his plugin.

- Deleted "reloadepg" and "azepgmgr" from svn bin directory because no more used.
- Added two script file in svn project "azopen_svnmk.sh" and "azopen_mk.sh"
to help to update and/or make bin file.
- Fixed detailed info for EPG event.
- Changed print info filter with new function for debugging
- Modified "azboxepg" to fix time offset issue.
- Modified "azboxepg" to display EPG update progress info with azbox display.
- Modified "azboxepg" with updated source file.
- Modified "azboxepg" with new variable to set custom channels list file.
- Modified "azboxepg" with temporary log file.
- Added in "azboxepg" more parameter for print info.
 

marce

VIP
Messages
7,115
AZBox OpenTools 1.6a


Code:
History:
========
1.6a- 2010-06-08 - bpmurray - Cleaned up the script, making the date
auto-detected, thereby fixing the 404 error.
 

elgeneral

Registered
Messages
7,811
AZBox OpenTools 1.7

History:

========
1.7 - 2010-06-21 - bpmurray - Updated to take into account updates to the
SDK. This means that it requires firmware 0.9.4923 or later.
 

marce

VIP
Messages
7,115
AZBox OpenTools 1.8


Code:
This describes the changes made for each version. For details on how
to use the program, see the README file in the executables directory.
For details about development of the program, see the README file in
the source directory.

Known issues:
=============
* Errors occur when committing data to the EPG - I don't know why these
happen, so need help from the dev folk. The effect is that when you
try to load the full EPG list, it loses a lot of the information.
* Some of the EPG data are not loaded - it appears that the channels are
not identified correctly. Perhaps the rytec information is inaccurate.

History:
========
1.8 - 2010-08-20 - bpmurray - The last couple of versions didn't work well
on some systems: this update fixes that. There are also a number of
optimizations that make reloading of the data very fast, particularly
exploiting the new epg persistence in the firmware.
 
Status
Not open for further replies.
Top