Linq To Sql: POCO and Value Objects
Fetching POCO Entities and Value Objects using Linq To SQL
Linq To Sql support neither POCO Entities nor Value Objects when using it as an O/R Mapper.
What we can do is to treat it as a simple auto generated Data Access Layer instead.
By treating it as a DAL we can manually handle the data to object transformations in a type safe manner.
If we for example want to fetch a list of POCO Customers that also have an immutable Address value object associated to them,
we could use the following code to accomplish this:
//Poco prefix only used to distinguish between l2s and poco entities here
IList<Customer> FindCustomers(string name)
{
var query = from customer in context.Customers
where customer.Name == name
select new PocoCustomer
{
Id = customer.Id,
Name = customer.Name,
Address = new PocoAddres
(customer.AddressStreet,
customer.AddressZipCode,
customer.AddressCity)
};
return query.ToList();
}
This approach is quite handy if you work with multiple data source and don’t want to mix and match entities with different design in the same domain.
I’m sure many will find this approach quite dirty, but I find it quite pragmatic;
You can be up and running with a clean domain model in just a few minutes and simply hide the Linq To Sql stuff behind your DAL classes.
This works extremely well if you are into the “new” Command Query Separation style of DDD.
You can use Linq To Sql to create typed transformations from your Query layer and expose those as services.
Personally I’ve grown a bit tired of standard O/R mapping frameworks, simply because they try to do too much.
There is a lot of magic going on, it’s hard to keep track on what gets loaded into memory and when they will hit the database.
If I’m required to use both a memory profiler and a O/R mapper profiler in order to use the framework successfully, then something is very wrong with the whole concept.
This dumbed down DAL approach to Linq To Sql however makes the code quite explicit, you know when you hit the DB and what you get from it.
Sure you lose features like dirty tracking that mappers generally give you, but this can be accomplished by applying a Domain Model Management framework on top of your POCO model.
Or maybe you just want to expose your objects as services and don’t care about those features.
[Edit]
In reply to Patriks comment:
If you go for Command Query Separation, you would only query the query layer, so you wouldn’t need to handle updates there.
And when it comes to writing data, you do that in the command layer , the commands carries the changes made from the GUI and thus you wouldn’t need to “figure out” what has changed.
The commands will carry that information for you.
Tracking changes in the GUI could simply be done by storing snapshots of the view specific data when you send a query.
Then pass a user modified projection together with the original snapshot to a command builder.
You could then submit the commands for processing.
[/Edit]
( hmmm, I somehow managed to turn a post about Linq To Sql into a rant about other O/R mappers, I usually do it the other way around :-) )
Linq To Sql: Dynamic Where Clause
Dynamic where clause using Linq To SQL:
Let’s say we need to implement a search method with the following signature:
IEnumerable FindCustomers(string name,string contactName,string city)
If the requirement is that you should be able to pass zero to three arguments to this method and only apply a “where” criteria for the arguments that are not null.
Then we can use the following code to make it work:
IList<Customer> FindCustomers(string name,string contactName,string city)
{
var query = context.Cutomers;
if (name != null)
query = query.Where ( customer => customer.Name == name );
if (contactName != null)
query = query.Where ( customer => customer.ContactName == contactName );
if (city!= null)
query = query.Where ( customer => customer.City == city );
return query.ToList();
}
This way we can pass different combinations of arguments to the method and it will still build the correct where clause that executes at database level.
Do note that this only works when the different criteria should be “AND”‘ed together, but it’s still pretty useful for use cases like the one above.
Two flavors of DDD
I have been trying to practice domain driven design for the last few years.
During this time, I have learnt that there are almost as many ways to implement DDD as there are practitioners.
After studying a lot of different implementations I have seen two distinct patterns.
I call the first pattern “Aggregate Graph”:
When applying aggregate graphs, you allow members of one aggregate to have direct associations to another aggregate.
For example, an “Order” entity which is part of a “Order aggregate” might have a “Customer” property which leads directly to a “Customer” entity that is part of a “Customer aggregate”.

According to Evans book this is completely legal, any member of an aggregate may point to the root of any other aggregate.
Evans is very clear on the matter that aggregate root identities are global while identity of non root entities are local to the aggregate itself.
The opposite pattern would be what I call “Aggregate Documents”:
Here the aggregates never relate _directly_ to other aggregate roots.
Instead, the associations may be designed as “snapshots” where you store light weight value object clones of the related aggregate roots.
An “Order” entity would have a “Customer” property which leads to a “CustomerSnapshot” value object instead of a Customer entity.
This way each aggregate instance becomes more of a free-floating document.

Since I have been applying both of these patterns, I will try to highlight the pros and cons of them in the rest of this post.
Aggregate Graph
The Aggregate Graph pattern is the approach I used when I first started doing DDD and I think that it is the most common way to implement DDD.
Since I was an O/RM developer (NPersist) this felt very natural to me, I could design my object graph in our design tool and then draw a few boxes on top of it and claim that those were my aggregates.
I most often used eager load inside the aggregates and lazy load between aggregates in order to avoid that the entire database was fetches when one aggregate instance was loaded.
This had a very nice “OOP” feel to it, I was working with objects and associations and I could ignore that there even was a database involved.
My “Repositories” were mere windows into my object graph, I could ask a repository to give me one or more aggregate roots and from those object I could pretty much navigate to any other object in the graph due to the spider web nature of the aggregate graph.

The pros of this approach is that it is easy to understand, you design your domain model just like any other class model.
It also works very well with O/R mappers, features like Lazy Load and Dirty Tracking makes it all work for you.
However, there are a few problems with this approach too.
Firstly, Lazy Load in O/R mappers is an implicit feature, there is no way for a developer to know at what point he will trigger a roundtrip to the database just by reading the code.
It always looks like you are traversing a fully loaded object graph while you are in fact not.
This often leads to severe performance problems if your development team don’t fully understand this.
I have seen reports over this kind domain models where the implicit nature of Lazy Load have caused some 700 round-trip to the database in a single web page.
This is what you get when you try to solve an explicit problem in an implicit way.
If you are going to use Lazy Load, make sure your team understands how it works and where you use it.
Another problem with this approach arise when you need to fill your entities with data from multiple sources.
Many of the applications I build nowadays relies on data from multiple sources, it could be a combination of services and internal databases.
When using Lazy Load to get related aggregates, there is no natural point where you can trigger calls to the other data sources and fill additional properties.
You will most likely have to hook into your O/R mapper in order to intercept a lazy load and call the services from there.
nowadays, I mostly use the second approach, Aggregate Documents.
Aggregate Document
Aggregate Document approach is much more explicit in its design.
For example, if you want to find the orders for a specific customer;
Instead of navigating the “Orders” collection of “Customer”, you will have to call a “FindOrdersByCustomer” query on the “OrderRepository”.
While I do agree that this looks less object oriented than the first approach, this allows developers to reason about the code in a different way.
They can see important design decisions and hopefully avoid pitfalls like ripple loading.
Another benefit is that since you only work with islands of data, you can now aggregate data from multiple sources much easier.
You can simply let your repositories aggregate the data into your entities.
(If you do it inside the actual repository or let the repository use some data access class that does it for it is up to you)

You don’t have to hook into any O/RM infrastructure since you no longer rely on lazy load between aggregates.
Personally I use eager load inside my aggregates, that is, I fetch “Order” and “Order Detail” together as a whole.
A side effect of this is that since I don’t use Lazy Load between aggregates and don’t use Lazy Load inside my aggregates, my need for O/R mapping frameworks drops.
I can apply this design without using a full-fledged O/R mapper framework.
I’m not saying that you should avoid O/R mapping, just that it is much easier to apply this pattern if you can’t use an O/R mapper for some reason.
This also makes it easier to expose your domain model in an SOA environment.
You can easily expose your entities or DTO versions of them in a service.
Lazy Load and services don’t play that well together.
Maybe it looks like I dislike the first approach, this is not the case, I may very well consider it in a smaller project where there is just one data source and where the development team is experienced with O/R mapping.
You can also create hybrids of the two approaches;
e.g. In Jimmy Nilsson’s book “Applying Domain Driven Design and Patterns” there are examples where an “Order” aggregate have a direct relation to the “Product” aggregate while the same “Order” aggregate uses snapshots instead of direct references to the “Customer” aggregate.
Snapshots also comes with the benefit of allowing you to store historical data.
The snapshot can for example store both the CustomerId and the name of the customer at the time the order was placed.
Thats all for now.
//Roger
Composite Oriented Programming: QI4J running on .NET
For the last month I have been spending my spare time porting the awesome Java framework QI4J to .NET.
QI4J is the brain child of Rickard Öberg and Niclas Hedhman and it attempts to enable Composite Oriented Programming for the Java platform.
(For more info regarding Composite Oriented Programming see the QI4J website: http://www.qi4j.org/ )
I’m well aware that others have been doing spikes on COP for .NET, a few of those attempts can be found here:
http://stackoverflow.com/questions/152196/composite-oriented-programming-cop-net-4-0-mef-and-the-oslo-repository
However, I think it is sad to not reuse all of the effort and brain power that has been put into QI4J, and thus I decided to port it instead.
The code is currently only available from my SVN repository at google code:
http://code.google.com/p/alsing/source/checkout
Please note that the code will be released under the same license as the Java version (Apache License version 2.0)
And copyright notices for the ported code will also be applied to give credit where credit is due.
The .NET version is largely identical to the Java version as it is pretty much a plain class by class port.
However there are a few exceptions:
The concept of “Property<T>” is not available in the .NET version since C# and most .NET languages does support properties out of the box and it would feel awkward to write things like:
“order.Customer.Set(theCustomer)” rather than “order.Customer = theCustomer”
However, the framework does rely on the Property<T> internally and thus most of the state holding infrastructure is also identical to the Java version.
The Java version relies on its own set of query expressions while my plan is to possibly reuse those internally but rather expose a LINQ API for querying.
(I have not yet started to build that)
Currently supported concepts:
- Transient Composites.
- Prototyping
- Typed and Generic Concerns.
- Typed and Generic Side Effects.
- Typed Mixins, Generic Mixins and Private Mixins.
- Most of the QI4J injection annotations.
Soon to come:
- Value Composites
- Service Composites
- Immutable properties
- Abstract Mixins (which sadly won’t be as nice as in Java due to language differences)
And I will ofcourse post a few samples of what you can do with this ASAP, I just wanted to drop a little sneak peek :-)
//Roger
Entity Framework 4 – Entity Dependency Injection
When dealing with a fat domain model, there is often a need to be able to inject different services into your entities.
e.g. you might want to inject some domain service like “ITaxCalcualtorService” or an infrastructure service like “IEmailNotificationService” into your entities.
If we rely completely on eager loading, then this is not a big problem, we can simply let or repositories iterate over each entity once we have fetched them from the DB and inject our services.
But when it comes to Lazy Load, we can no longer do this, in this case we need to get notified by the O/R mapper when an entity have been materialized so that we can inject our services into it.
If you are aiming to use Entity Framework 4 once it is released, you can accomplish this with the following code snippet:
..inside your own EF container class..
public MyContext()
: base("name=MyContext", "MyModelContainer")
{
...
ObjectStateManager.ObjectStateManagerChanged +=
ObjectStateManagerChanged;
}
// this handler gets called each time the
// containers statemanager is changed
void ObjectStateManagerChanged(object sender,
CollectionChangeEventArgs e)
{
// we are only interested in entities that
// have been added to the state manager
if (e.Action != CollectionChangeAction.Add)
return;
var state = ObjectStateManager
.GetObjectStateEntry(e.Element).State;
// we are only interested in entities that
// are unchanged (that is; loaded from DB)
if (state != System.Data.EntityState.Unchanged)
return;
OnEntityMaterialized(e.Element);
}
// this method gets called each time
// an entity have been materialized
private void OnEntityMaterialized(object entity)
{
if (entity is Order)
{
Order order = entity as Order;
// use property injection to assign
// a taxcalculator service to the order
order.TaxCalculatorService =
SomeDIContainer.GetObject<ITaxCalculatorService>();
}
}
The above is a very naïve example, but it does show how you can catch the materialization of a specific entity type and then configure that entity.
This allows us to add complex domain logic to our entities.
We can for example call a method like: “order.CalculateTotals()” where the CalculateTotals method now uses the ITaxCalculatorService.
HTH.
//Roger
Entity Framework 4 – “Almost” POCO
This is a short rant..
I have been very impressed with EF4 so far, but I’ve now found out that EF4 will NOT support enums.
I find this is very strange, I can’t see how Microsoft can claim POCO support and not support one of the most common code constructs.
More info here:
http://social.msdn.microsoft.com/Forums/en-US/adonetefx/thread/7659feab-d348-4367-b2cd-0456b20262fe
Someone might claim that you can create a private property containing the mapped integer value and then make a public property exposing the enum.
But this comes with two major drawbacks:
1) You can’t create Linq queries that are executed at DB level if you use unmapped properties.
The Linq query would have to use the integer property, and thus loosing it’s semantics.
2) That is not POCO, that is mapper requirements leaking all over the place.
Entity Framework 4 – Using Eager Loading
When Linq To Sql was released we were told that it did support eager loading.
Which was a bit misleading, it did allow us to fetch the data we wanted upfront, but it did so by issuing one database query per object in the result set.
That is, one query per collection per object, which is a complete performance nightmare. (Ripple loading)
Now in Entity Framework 4, we can actually do true eager loading.
EF4 will issue a single query that fetches the data for all the objects in a graph.
This have been possible in other mappers for a long time, but I still think it is awesome that Microsoft have finally listened to the community and created a framework that from what I’ve seen so far, does exactly what we want.
So how do you use eager loading in EF4 ?
Eager loading is activated by calling “ObjectSet[of T].Include(“Details.Product”)”, that is, a dot separated property path.
You can also call include multiple times if you want to load different paths in the same query.
There are also a few attempts out in the blog world to try to make it easier to deal with eager loading, e.g. by trying to remove the untyped string and use lambda expressions instead.
I personally don’t like the lambda approach since you can’t traverse a collection property that way; “Orders.Details.Product” , there is no way to write that as a short and simple lambda.
My own take on this is to use extension methods instead.
I always use eager loading on my aggregates, so I want a simple way to tell my EF context to add the load spans for my aggregates when I issue a query.
(Aggregates are about consistency, and Lazy Load causes consistency issues within the aggregate, so I try to avoid that)
Here is how I create my exstension methods for loading complete aggregates:
public static class ContextExtensions
{
public static ObjectQuery<Order>
AsOrderAggregate(this ObjectSet<Order> self)
{
return self
.Include("Details.ProductSnapshot")
.Include("CustomerSnapshot");
}
}
This makes it possible to use the load spans directly on my context without adding anything special to the context itself.
(You can of course add this very same method inside your context if you want, I simply like small interfaces that I can extend from the outside)
This way, you can now issue a query using load spans like this:
var orders = from order in context.OrderSet.AsOrderAggregate()
select order;
And if you want to make a projection query you can simply drop the “AsOrderAggregate” and fetch what you want.
HTH.
//Roger
Entity Framework 4 – Managing inverse properties
[EDIT]
I was wrong!
It is perfectly possible to do one directional associations in EF4 and POCO mode.
You simply have to manually remove the “ <NavigationProperty ..” tags from your mapping files.
Awesome work EF4 design team :-)
[/EDIT]
Original post:
To my surprise I’ve found out that Entity Framework 4 don’t support one directional collection properties.
That is, if you have the entity “Order” which has an “Details” property, then the “OrderDetail” entity _must_ have an “Order” property.
To make things worse, those properties do not have any auto sync mechanism if you are using POCO entities.
They could very well have supported this by adding an inverse management aspect to their run-time proxies that they use for lazy loading in POCO.
While I do think this is a lacking feature, it is not really a show stopper for me.
We can work around this problem by applying the “Law of Demeter” principle.
We can design our entities like this:
OrderDetail:
public class OrderDetail
{
...properties...
[Obsolete("For EF4 Only!",true)]
public OrderDetail()
{ }
public OrderDetail(Order order)
{
this.Order = order;
}
}
Order:
public class Order
{
...properties...
public void AddProduct(Product product,
double quantity,
double itemPrice)
{
var detail = new OrderDetail(this)
{
//offtopic: you might want to associate
//the product via ID or via a snapshot instead
//depending on how you deal with cross aggregate references
Product = product,
Quantity = quantity,
ItemPrice = itemPrice,
};
Details.Add(detail);
}
}
This way, we get a whole bunch of positive effects:
We solve the problem with inverse properties, inverse management is handled inside the “AddProduct” method in the order.
We get a nice way to handle consistency in our aggregate roots, the methods can easily update any accumulated values in the order or change status of the order when we add or remove order details.
This is what aggregates in DDD is all about so you should probably do this anyway, regardless if EF4 did support inverse property management or not.
We add domain semantics to the model, “AddProduct” or “ChangeQuantity” have meaning in our model, thus we get a more self explaining model.
This is a quite nice example of how lacking framework features can force you to write better code.
If we did have support for inverse property management, we might get sloppy and just go the path of least resistance.
//Roger
Entity Framework 4 – Where Entity.Id in Array
Here is a little trick if you want to issue a query to the database and select a batch of entities by ID only:
//assemble an array of ID values
int[] customerIds= new int[] { 1, 2, 3 };
var customers = from customer in context.CustomerSet
where customerIds.Contains(customer.Id)
select customer;
This will make Entity Framework issue an SQL query with the where clause “where customerId in (1,2,3)”, and thus, you can batch select specific entities with a single query.
I will get back to this idea in a later post because this is related to how I design my entities and aggregates in DDD.
//Rogerr
Entity Framework 4 – Immutable Value Objects
Ok, the title is not quire accurate, I’m not aware of any way to accomplish truly immutable types for Entity Framework.
However, this is a quite nice attempt IMO:
public class Address
{
//Private setters to avoid external changes
public string StreetName { get;private set; }
public string City { get; private set; }
public string ZipCode { get; private set; }
//Provide a default ctor for EF4
[Obsolete("For EF4 Only",true)]
public Address() {}
//Force values to be set via ctor.
public Address(string streetName, string city, string zipCode)
{
StreetName = streetName;
City = city;
ZipCode = zipCode;
}
...equality overrides and such...
}
This works very well with Entity Framework 4 and I think it is a fair compromise.
//Roger
Design by