Daniel Warneke

Daniel Warneke

I am an architect at Amadeus, one of the biggest providers for travel IT worldwide, responsible for introducing new big data-related technologies into the company's global IT landscape. Besides, I am a PMC/committer for Apache Flink, a novel distributed data analytics platform, developed under the umbrella of the Apache Software Foundation (ASF).

I received a Ph.D. in computer science from TU Berlin for my work on massively-parallel data processing on cloud platforms. My general interests are big data platforms, large-scale distributed systems/databases, and IT infrastructures.

ICSIEM




View Daniel  Warneke's profile on LinkedIn

Publications

In the past I conducted research in the areas of big data analytics, scalable distributed systems, and (wireless) computer networks. So far, I have (co-)authored over 20 peer-reviewed research papers. For recent information on the impact of my publications (including citation counts, h-index, etc.), please check my Google Scholar profile.
Journal Papers
B. Lohrmann, D. Warneke, O. Kao, "Nephele Streaming: Stream Processing under QoS Constraints at Scale", Cluster Computing, 17(1), pp. 61-78, 2014
[BibTeX] [Publisher's version]

A. Alexandrov, R. Bergmann, S. Ewen, J. Freytag, F. Hueske, A. Heise, O. Kao, M. Leich, U. Leser, V. Markl, F. Naumann, M. Peters, A. Rheinländer, M. Sax, S. Schelter, M. Höger, K. Tzoumas, D. Warneke, "The Stratosphere Platform for Big Data Analytics", The VLDB Journal, pp. 163-181, 2014
[PDF] [BibTeX] [Publisher's version]

M. Höger, O. Kao, P. Richter, D. Warneke, "Ephemeral Materialization Points in Stratosphere Data Management on the Cloud", Advances in Parallel Computing, 23(1), pp. 163-181, 2013
[BibTeX] [Publisher's version]

M. Hovestadt, O. Kao, A. Kliem, D. Warneke, "Adaptive Online Compression in Clouds - Making Informed Decisions in Virtual Machine Environments", Journal of Grid Computing, 11(2), pp. 167-186, 2013
[BibTeX] [Publisher's version]

P. Berndt, M. Hovestadt, O. Kao, D. Warneke, "Cloud-basierte Infrastrukturen", IM Fachzeitschrift für Information Management & Consulting, 2(26), pp. 18-24, 2011
[BibTeX] [Publisher's version]

D. Warneke, C. Dannewitz, "Load Balancing in P2P Networks: Using Statistics to Fight Data and Execution Skew", Journal of Advances in Information Technology (JAIT) - Special Issue on Advances in P2P Technology, 2(1), pp. 40-49, 2011
[BibTeX] [Publisher's version]

D. Warneke, O. Kao, "Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud", IEEE Transactions on Parallel and Distributed Systems, 22(6), pp. 985-997, 2011, acceptance rate 24.0%
[PDF] [BibTeX] [Publisher's version]

A. Alexandrov, D. Battré, S. Ewen, M. Heimel, F. Hueske, O. Kao, V. Markl, E. Nijkamp, D. Warneke, "Massively Parallel Data Analysis with PACTs on Nephele", Proceedings of the VLDB Endowment, 3(1-2), pp. 1625-1628, 2010
[PDF] [BibTeX] [Publisher's version]

Peer-Reviewed Conference and Workshop Papers
D. Warneke, C. Leng, "A case for dynamic memory partitioning in data centers", in Proc. of the Second Workshop on Data Analytics in the Cloud (DanaC '13), pp. 41-45, 2013
[PDF] [BibTeX] [Publisher's version]

S. Ewen, S. Schelter, K. Tzoumas, D. Warneke, V. Markl, "Iterative parallel data processing with Stratosphere: An inside look", in Proc. of the 2013 international conference on Management of data (SIGMOD '13), pp. 1053-1056, 2013
[PDF] [BibTeX] [Publisher's version]

B. Lohrmann, D. Warneke, O. Kao, "Massively-parallel Stream Processing under QoS Constraints with Nephele", in Proc. of the 21st International Symposium on High-Performance Parallel and Distributed Computing (HPDC '12), pp. 271-282, 2012, acceptance rate 16.3%
[PDF] [BibTeX] [Publisher's version]

D. Battré, N. Frejnik, S. Goel, O. Kao, D. Warneke, "Inferring Network Topologies in Infrastructure as a Service Clouds", in Proc. of the 11th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGRID '11), pp. 604-605, 2011
[PDF] [BibTeX] [Publisher's version]

A. Alexandrov, S. Ewen, M. Heimel, F. Hueske, O. Kao, V. Markl, E. Nijkamp, D. Warneke, "MapReduce and PACT - Comparing Data Parallel Programming Models", in Proc. of the 14th Conference on Database Systems for Business, Technology, and Web (BTW 2011), pp. 25-44, 2011, acceptance rate 42.0%
[PDF] [BibTeX] [Publisher's version]

D. Battré, N. Frejnik, S. Goel, O. Kao, D. Warneke, "Evaluation of Network Topology Inference in Opaque Compute Clouds through End-to-End Measurements", in Proc. of the 4th IEEE International Conference on Cloud Computing (CLOUD '11), pp. 17-24, 2011, acceptance rate 18.0%
[PDF] [BibTeX] [Publisher's version]

M. Hovestadt, O. Kao, A. Kliem, D. Warneke, "Evaluating Adaptive Compression to Mitigate the Effects of Shared I/O in Clouds", in Proc. of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum (IPDPSW '11), pp. 1042-1051, 2011, acceptance rate 42.0%
[PDF] [BibTeX] [Publisher's version]

D. Battré, M. Hovestadt, B. Lohrmann, A. Stanik, D. Warneke, "Detecting Bottlenecks in Parallel DAG-based Data Flow Programs", in Proc. of the 2010 IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS '10), pp. 1-10, 2010, acceptance rate 34.0%
[PDF] [BibTeX] [Publisher's version]

D. Battré, S. Ewen, F. Hueske, O. Kao, V. Markl, D. Warneke, "Nephele/PACTs: A Programming Model and Execution Framework for Web-Scale Analytical Processing", in Proc. of the 1st ACM Symposium on Cloud Computing (SoCC '10), pp. 119-130, 2010, acceptance rate 19.0%
[PDF] [BibTeX] [Publisher's version]

D. Warneke, O. Kao, "Nephele: Efficient Parallel Data Processing in the Cloud", in Proc. of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS '09), pp. 8:1-8:10, 2009
[PDF] [BibTeX] [Publisher's version]

D. Warneke, C. Dannewitz, "Statistics-based ID Management for Load Balancing in Structured P2P Networks", in Proc. of the 34th IEEE Conference on Local Computer Networks (LCN '09), pp. 273-276, 2009, acceptance rate 31.0%
[BibTeX] [Publisher's version]

D. Warneke, U. Rerrer-Brusch, "Exchangeable, Application-Independent Load Balancing for P2P Simulation Frameworks", in Proc. of the 2nd International Workshop on OMNeT++ (OMNeT++ 2009), 2009
[BibTeX] [Publisher's version]

D. Battré, K. Djemame, I. Gourlay, M. Hovestadt, O. Kao, J. Padgett, K. Voss, D. Warneke, "AssessGrid Strategies for Provider Ranking Mechanisms in Risk-Aware Grid Systems", in Proc. of the 5th International Workshop on Grid Economics and Business Models (GECON 2008), pp. 226-233, 2008
[BibTeX] [Publisher's version]

C. Dannewitz, H. Karl, D. Warneke, "Service Platform for Real-World / Internet Integration in Mobile Applications", in Proc. of the 13. ITG-Fachtagung Mobilfunk, pp. 103-108, 2008
[BibTeX] [Publisher's version]

S. Valentin, H. Lichte, D. Warneke, T. Biermann, R. Funke, H. Karl, "Mobile Cooperative WLANs - MAC and Transceiver Design, Prototyping, and Field Measurements", in Proc. of the 68th IEEE Vehicular Technology Conference (VTC 2008-Fall), pp. 1-5, 2008, acceptance rate 46.5%
[PDF] [BibTeX] [Publisher's version]

Book Chapters
D. Warneke, "Ad-Hoc Parallel Data Processing on Pay-As-You-Go Clouds with Nephele", in Distributed Computing Innovations for Business, Engineering, and Science, IGI Global, Hershey, PA, USA, 2013
[BibTeX] [Publisher's version]

Ph.D. Thesis
D. Warneke, "Massively Parallel Data Processing on Infrastructure as a Service Platforms", Dissertation at the Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin, 2011
[PDF] [BibTeX] [Publisher's version]