On Unification
I presume you're asking whether just classical gravity & classical EM can be unified.
They sure can!
Classical General Relativity and Classical Electromagnetism are unified in Kaluza-Klein-Theory, which proves that 5-dimensional general relativity is equivalent to 4-dimensional general relativity plus 4-dimensional maxwell equations. Rather interesting, isn't it? A byproduct is the scalar "Radion" or "Dilaton" which appears due to the "55" component of the metric tensor. In other words, the Kaluza-Klein metric tensor equals the GR metric tensor with maxwell stuff on the right and at the bottom; BUT you have an extra field down there.
gμν=[g11g12g13g14g15g21g22g23g24g25g31g32g33g34g35g41g42g43g44g45g51g52g53g54g55]
Imagine 2 imaginary lines now.
gμν=[g11g12g13g14g15g21g22g23g24g25g31g32g33g34g35g41g42g43g44g45g51g52g53g54g55]
So the stuff on the top-left is the GR metric for gravity, and the stuff on the edge (gj5 and g5j) is for electromagnetism and you have an additional component on the bottom right. This is the radion/dilaton.
An extension to kaluza - klein is supergravity, which also talks about the weak and strong forces, and requires supersymmetry.
On Geometry
In quantum-electrodynamics, the gauge group for electromagnetism is U(1).
Now, the key thing here is that Electromagnetism is then The Curvature of the U(1) bundle.
This is not the only geometric connection between General Relativity and Quantum Field Theory. In the same context, the covariant derivatives is general relativity are such that ∇μ−∂μ sort-of measures the gravity, in a certain way, while this is also true in QFT, where to some constants, ∇μ−∂μ=igsAμ.
It is to be noted that both are in similiar context.