Given the inability of Highly-Distributed-Application-Developers to foresee the changes as well as the heterogeneity on the underlying infrastructure, it is considerable crucial the design and development of novel software paradigms that facilitate application developers to take advantage of the emerging programmability of the underlying infrastructure and therefore develop Reconfigurable-by-Design applications. In parallel, it is crucial to design solutions that are scalable, support high performance, are resilient-to-failure and take into account the conditions of their runtime environment. Towards this direction, the ARCADIA project aims to design and validate a Novel Reconfigurable-By-Design Highly Distributed Applications Development Paradigm over Programmable Infrastructure. The proposed framework will rely on the development of an extensible Context Model which will be used by developers directly at the source-code level. Proper Context-Model will be assisted and validated by IDE-plugins (for many IDEs) in order to re-assure that the generated executable files contain meaningful semantics. According to ARCADIA’s vision, the generated executables should be on-boarded by a Smart Controller which will undertake the tasks of translating annotations to optimal infrastructural configuration. Such a controller will enforce an optimal configuration to the registered programmable resources and will pro-actively adjust the configuration plan based on the Infrastructural State and the Application State. The Context-Model and the aforementioned ARCADIA toolset will be complemented by a Development Methodology that will assure that developed Highly Distributed Applications are Reconfigurable-By-Design. The framework is planned to be validated and evaluated on three use cases that will be deployed over testbeds that host heterogeneous programmable infrastructure.