From anthonyeden at gmail.com Thu Nov 9 09:20:22 2006 From: anthonyeden at gmail.com (Anthony Eden) Date: Thu, 9 Nov 2006 09:20:22 -0500 Subject: [Activewarehouse-discuss] First Usable Version in Subversion Message-ID: As of revision 58 in the subversion repository you can now use the ActiveWarehouse plugin to actually *do* something useful. Take a look at the code in the demo directory of the repository to see the first drillable report working using the AW plugin. Installing the demo is probably too much of a challenge for a casual user right now, so I'll be working on making it easier to setup. However, if you want to give it a whirl then try this: - Check out demo/trunk from the Subversion repo - Install the plugin (script/plugin install svn://rubyforge.org/var/svn/activewarehouse/activewarehouse/trunk) - Set up the database (aw_development) in MySQL - Migrate (rake db:migrate) - Run the setup script (ruby db/setup.rb) - Start the demo app (script/server) - Browse to http://localhost:3000/demo/ and hopefully be wowed by the warehousing magic. ;-) The above may need some tweaking. Feel free to post revisions to the above instructions or any issues with it and I'll update it. Sincerely, Anthony Eden From anthonyeden at gmail.com Mon Nov 13 08:04:34 2006 From: anthonyeden at gmail.com (Anthony Eden) Date: Mon, 13 Nov 2006 08:04:34 -0500 Subject: [Activewarehouse-discuss] Calculated Values now Supported Message-ID: AW now includes support for calculated values (revision 62). Calculated values are supported via blocks and are defined in your fact table. For example, here is what the demo PosRetailSalesTransactionFact looks like: class PosRetailSalesTransactionFact < ActiveWarehouse::Fact aggregate :sales_quantity#, :type => :sum aggregate :sales_dollar_amount#, :type => :sum aggregate :gross_profit_dollar_amount#, :type => :sum calculated_field (:gross_margin) { |agg_rec| agg_rec.gross_profit_dollar_amount / agg_rec.sales_dollar_amount} belongs_to :date, :foreign_key => 'date_id', :class_name => 'DateDimension' belongs_to :store, :foreign_key => 'store_id', :class_name => 'StoreDimension' end The calculated field :gross_margin is calculated by dividing the gross_profit_dollar_amount by the sales_dollar_amount. The report helper class will now display this calculated value as well. Note: If you have already installed the AW plugin and you are upgrading you will probably need to run rake warehouse:rebuild to rebuild and repopulate your aggregates. Sincerely, Anthony -- Email: anthonyeden at gmail.com Cell: 808 782-5046 Current Location: Melbourne, FL From anthonyeden at gmail.com Mon Nov 13 17:32:39 2006 From: anthonyeden at gmail.com (Anthony Eden) Date: Mon, 13 Nov 2006 17:32:39 -0500 Subject: [Activewarehouse-discuss] ActiveWarehouse New Features Message-ID: I've been steadily adding functionality to ActiveWarehouse while adding more examples and documentation. New features include: * Calculated fields, implemented as blocks * Custom formatters, implemented as blocks * Cleaned up report_helper * Auto rebuilding of aggregates when underlying fact or dimension classes change * Multi-dimensional cubes proven to work (see example 4 in the demo) * Added many additional unit tests Lots of other stuff has been cleaned up along the way. You can get the AW plugin from within your Rails app using: script/plugin install svn://rubyforge.org/var/svn/activewarehouse/activewarehouse/trunk --force Enjoy. -- Email: anthonyeden at gmail.com Cell: 808 782-5046 Current Location: Melbourne, FL From anthonyeden at gmail.com Thu Nov 16 09:19:53 2006 From: anthonyeden at gmail.com (Anthony Eden) Date: Thu, 16 Nov 2006 09:19:53 -0500 Subject: [Activewarehouse-discuss] ActiveWarehouse ETL Message-ID: I've started throwing together some code for ETL in ActiveWarehouse. It's in a separate section of the Subversion repo if anyone is interested. A brief write up is here: http://anthonyeden.com/2006/11/16/activewarehouse-etl Repo URL: svn://rubyforge.org/var/svn/activewarehouse/etl/trunk Enjoy. -Anthony -- Email: anthonyeden at gmail.com Cell: 808 782-5046 Current Location: Melbourne, FL From shawn.hansen at gmail.com Mon Nov 27 23:40:21 2006 From: shawn.hansen at gmail.com (Shawn Hansen) Date: Mon, 27 Nov 2006 22:40:21 -0600 Subject: [Activewarehouse-discuss] [Rails] Re: Data Warehousing In-Reply-To: References: <456B5458.4070309@gmail.com> Message-ID: <456BBDB5.5000804@gmail.com> My data warehousing skills are lacking at best, and rusty at worst. I implemented a warehouse about six years ago for a retail chain, but have not touched warehousing since. I'm working on a personal project now, and it suddenly dawned on me that a data warehouse was the way to go. The project I am working on is a typical rails app that I have assembled in a more traditional relational model. It has a lot of the functionality I need already, but I would like the benefits of dimensional modeling. I guess the one thing that wasn't clear to me was how rails would handle the fact-to-dimension relationship. The has_many's, belongs_to's, etc. So a dimension has many facts, and a fact belongs to dimension a, dimension b, dimension c, etc? Or am I missing something? Thank you for your quick response earlier, Shawn Hansen Anthony Eden wrote: > Shawn, > > Implementing the schema is fairly easy...you have a model for each of > you dimensions and model for each of your facts. The facts will have > foreign keys which reference the dimensions that are connected to that > fact. You can and should reuse dimensions. > > AW works on top of AR and adds additional functionality like auto > creation of aggregation storage tables, UI helpers, etc. > > If you would like to talk about ActiveWarehouse or data warehousing in > general then feel free to email me directly or join the > ActiveWarehouse mailing list. > > Sincerely, > Anthony Eden > > On 11/27/06, Shawn Hansen wrote: > >> Are the transcripts from RailsConf 2006 available? I'm specifically >> looking for the data warehousing talk from Ken Kunz. >> >> I've looked at the ActiveWarehouse plugin, but have not completely >> grokked what is going on there yet. >> >> I was hoping to read through, or listen to, Ken's talk from the >> conference. It sounds exactly like the information I'm looking for. >> I'm just looking for the proper way to implement the warehouse star >> schema inside of rails. >> >> > > > From anthonyeden at gmail.com Tue Nov 28 06:45:10 2006 From: anthonyeden at gmail.com (Anthony Eden) Date: Tue, 28 Nov 2006 06:45:10 -0500 Subject: [Activewarehouse-discuss] [Rails] Re: Data Warehousing In-Reply-To: <456BBDB5.5000804@gmail.com> References: <456B5458.4070309@gmail.com> <456BBDB5.5000804@gmail.com> Message-ID: Shawn, You are spot on with the relationships. Facts belong to dimensions and dimensions have many facts. V/r Anthony On 11/27/06, Shawn Hansen wrote: > My data warehousing skills are lacking at best, and rusty at worst. I > implemented a warehouse about six years ago for a retail chain, but have > not touched warehousing since. > > I'm working on a personal project now, and it suddenly dawned on me that > a data warehouse was the way to go. The project I am working on is a > typical rails app that I have assembled in a more traditional relational > model. It has a lot of the functionality I need already, but I would > like the benefits of dimensional modeling. > > I guess the one thing that wasn't clear to me was how rails would handle > the fact-to-dimension relationship. The has_many's, belongs_to's, etc. > > So a dimension has many facts, and a fact belongs to dimension a, > dimension b, dimension c, etc? Or am I missing something? > > Thank you for your quick response earlier, > Shawn Hansen > Anthony Eden wrote: > > Shawn, > > > > Implementing the schema is fairly easy...you have a model for each of > > you dimensions and model for each of your facts. The facts will have > > foreign keys which reference the dimensions that are connected to that > > fact. You can and should reuse dimensions. > > > > AW works on top of AR and adds additional functionality like auto > > creation of aggregation storage tables, UI helpers, etc. > > > > If you would like to talk about ActiveWarehouse or data warehousing in > > general then feel free to email me directly or join the > > ActiveWarehouse mailing list. > > > > Sincerely, > > Anthony Eden > > > > On 11/27/06, Shawn Hansen wrote: > > > >> Are the transcripts from RailsConf 2006 available? I'm specifically > >> looking for the data warehousing talk from Ken Kunz. > >> > >> I've looked at the ActiveWarehouse plugin, but have not completely > >> grokked what is going on there yet. > >> > >> I was hoping to read through, or listen to, Ken's talk from the > >> conference. It sounds exactly like the information I'm looking for. > >> I'm just looking for the proper way to implement the warehouse star > >> schema inside of rails. > >> > >> > > > > > > > > _______________________________________________ > Activewarehouse-discuss mailing list > Activewarehouse-discuss at rubyforge.org > http://rubyforge.org/mailman/listinfo/activewarehouse-discuss > -- Email: anthonyeden at gmail.com Cell: 808 782-5046 Current Location: Melbourne, FL