Since the seminal discoveries of giant magnetoresistance in magnetic multilayers and tunneling magnetoresistance in magnetic tunnel junctions, the exploration of spin-dependent electronic transport has provided a promising avenue for applications in data storage and processing. Devices based on the electron spin typically require the application of magnetic fields or spin torques generated by large currents, consuming power and producing heat, hence limiting applications. To avoid the need for large currents, there have been recent efforts toward manipulating magnetization with electric fields. Such magnetoelectric effects can be induced at the surfaces and interfaces of ferromagnetic metals affecting both the interface magnetization and the interface anisotropy. Ferroelectric materials are especially helpful in this regard because they possess a spontaneous electrical polarization which, when reversed by an electric field, can induce a large magnetoelectric response at the interface with a magnetic metal. Importantly, ferroelectric films can now be made thin enough to allow measurable electron tunneling while maintaining a stable and switchable polarization. Modeling and experiments show that ferroelectric tunnel junctions allow producing giant resistive-switching effects and the control of spin-polarization of the tunneling current. I will present our recent research efforts and discuss underlying physical principles associated with magnetoelectric interfaces and the effect of ferroelectricity on magnetism and spin transport.