Difference between revisions of "Modeling for cloud"

From Knoesis wiki
Jump to: navigation, search
(More minor changes)
(More changes)
 
Line 67: Line 67:
 
Semantic modeling can help with this.<br /><br />
 
Semantic modeling can help with this.<br /><br />
  
[[File:Chart4.png|380px]]
+
[[File:Chart4.png]]
 
+
  
 
<span style="font-size:12pt;color:purple">Cloud Interoperability?</span><br />
 
<span style="font-size:12pt;color:purple">Cloud Interoperability?</span><br />
Line 147: Line 146:
 
must cover.
 
must cover.
  
[[File:Chart1.png|380px]]
+
[[File:Chart1.png]]
  
 
The­ language­ abstraction­ level  
 
The­ language­ abstraction­ level  
Line 289: Line 288:
 
software deployment and management. Elastra’s Elastic Computing  
 
software deployment and management. Elastra’s Elastic Computing  
 
Modeling Language (ECML),   
 
Modeling Language (ECML),   
 
<br /><br />
 
[[File:Chart1.png]]
 
 
<br /><br />
 
  
 
[[File:Chart2.png]]
 
[[File:Chart2.png]]
<br /><br />
 
  
 
Elastic Deployment Modeling Language  
 
Elastic Deployment Modeling Language  

Latest revision as of 15:34, 3 August 2010

Semantic Modeling for Cloud Computing

Amit Sheth and Ajith Ranabahu • Wright State University

Cloud computing has lately become the attention grabber in both academia and industry. The promise of seemingly unlimited, readily available utility-type computing has opened many doors previously considered difficult, if not impossible, to open. The cloud- computing landscape, however, is still evolving, and we must overcome many challenges to foster widespread adoption of clouds. The main challenge is interoperability. Numerous vendors have introduced paradigms and services, making the cloud landscape diverse and heterogeneous. Just as in the computer hardware industry’s early days, when each vendor made and marketed its own version of (incompatible) computer equipment, clouds are diverse and vendor-locked. Although many efforts are under way to standardize clouds’ important technical aspects, notably from the US National Institute of Standards and Technology (NIST), consolidation and standardization are still far from reality. In this two-part article, we discuss how a little bit of semantics can help address clouds’ key interoperability and portability issues.

Cloud-Related Challenges

Figure 1 shows the three main flavors of clouds as outlined by NIST (http://csrc.nist.gov/groups/SNS/cloud-computing). Infrastructure-as-a-­ service (IaaS) clouds have the largest gap (a high workload but little automation) in terms of deploying and managing an application. Platform-as-a-service (PaaS) or software-as-a-service (SaaS) clouds have substantially lower workloads, but at the expense of flexibility and portability. Given this diverse environment, a cloud service consumer faces four challenges. First, depending on the application’s requirements, legal issues, and other possible considerations, the consumer must select a cloud to use. Each cloud vendor exposes these details in different formats and at different granularity levels. Second, the consumer must learn about the vendor’s technical aspects (service interface, scaling configuration, and so on) and workflow. Third, the consumer must then develop an application or customize the vendor-provided multitenant application to fulfill his or her requirements. When doing this, the consumer must take into account various technical details such as the choice of programming language and limitations in the application runtime, which will all be vendor-specific. Finally, after deploying the application, if the consumer must change the service provider (which happens surprisingly often), at least two major considerations arise. First, the consumer might need to rewrite or modify the application code to suit the new provider’s environment. For some clouds (such as IaaS), this is minimal, but porting the code in PaaS and SaaS clouds will likely require more effort. The second consideration is that data collected for the application might need transformation. Data is the most important asset the application generates over time and is essential for continued functioning. The transformation might even need to carry across different data models. The industry practice is to address such transformations case-by-case. To overcome these challenges and provide better insight into the aspects requiring attention, proper modeling in this space is essential. Semantic modeling can help with this.

Chart4.png

Cloud Interoperability?
First, a word about cloud interoperability is in order. Interoperability requirements in the cloud landscape in Figure 1 arise owing to two types of heterogeneities.The first is vertical heterogeneity — that is, within a single silo. We can address this by using middleware to homogenize the API and sometimes by enforcing standardization. For example, the Open Virtualization Format (OVF ) is an emerging standard that allows migration of virtual-machine snapshots across IaaS clouds. The second type is horizontal heterogeneity—that is, across silos. Overcoming this is fundamentally more difficult. Each silo provides different abstraction levels and services. High-level modeling pays off, especially when you must move an application and code horizontally across these silos. Surprisingly, many small and medium businesses make horizontal transitions. PaaS clouds offer faster setup for applications, and many exploit the free hosting opportunities of some platform cloud providers (for example, Google’s App Engine). When the application grows in scope and criticality, however, an IaaS cloud might prove cheaper, more flexible, and more reliable, prompting a transition. The following discussion on semantic models applies to both vertical and horizontal interoperability. The key in addressing both types is that many of the core data and services causing them follow the same semantic concepts. For example, almost all IaaS clouds follow conceptually similar workflows when allocating resources, although the actual service implementations and tools differ significantly. Similarly, the PaaS modeling space is a subset of that for IaaS, from a semantic perspective. These observations prompt us to argue for semantic models’ applicability, especially to supplement interoperability in the cloud space. Some parts of the scientific and engineering community weren’t impressed by early semantic-modeling approaches, especially ones that required large up-front investment. This perception, however, is changing rapidly with the influx of new applications and technologies that exploit detailed semantic models to provide improved functionality (for example, biomedical ontologies cataloged at the US National Center for Biomedical Ontology ). Semantic models such as ontologies can formalize more details than other traditional modeling techniques. They also enable reasoning, a way to make inferences and gain new knowledge. Such rich models can improve traditional functions far beyond what was once thought possible. For example, Powerset (now part of Microsoft), a search service provider, added considerable value to search results by incorporating semantic models and thus enabling fact discovery. These capabilities are being complemented by the ability to more rapidly create domain models, often by mining crowd knowledge represented, for example, in Wikipedia1 or shared data, exemplified by the linked-object data cloud. The technologies showcased at the Semantic Technology Conference also provide plenty of evidence of semantic-empowered commercial and scientific applications.

Multidimensional Analysis of Cloud-Modeling Requirements

We suggest a 3D slicing of the modeling requirements along the following dimensions (see Figure 2). The­ types­ of­ semantics that are useful for porting or interoperability in cloud computing are similar to those we introduced in 2003 for Web services. This is natural because the primary means of interacting with a cloud environment is through Web services. The four types of semantics—data, functional, nonfunctional, and system—are based on the different semantic aspects a model must cover.

Chart1.png

The­ language­ abstraction­ level indicates the modeling’s granularity and specificity. Although ontological modeling is preferable at a higher level, developers prefer detailed, concrete syntactic representations. These representations of different granularities might need to be related, often through explicit annotations. For example, although service developers happily use Web Services Description Language (WSDL) descriptions in their Web services, these descriptions are syntactic and can’t provide useful semantic details. To overcome this deficiency, SAWSDL (Semantic Annotations for WSDL and XML Schema; www.w3.org/TR/sawsdl) attaches semantic-model details to WSDL documents. The­ software­ lifecycle­ stage is important in determining the modeling requirements. For example, some nonfunctional and system requirements might not be modeled during development but will be taken into account only during deployment. A different team handles each of these lifecycle stages; this separation is important so that one team doesn’t step on another’s toes. This separation aims to focus the modeling effort on the correct time and people. Some cloud models fall under the nonfunctional/system/ ontology space in Figure 2. Such models include the Elastic Computing Modeling Language (ECML), Elastic Deployment Modeling Language (EDML), and Elastic Management Modeling Language (EMML), all based on OWL and published by Elastra (Elastra Languages). However, some aspects of cloud modeling have received little or no attention. For example, there’s no comprehensive higher-level modeling in the data and functional spaces. Lessons learned during large-scale ontological modeling in the Semantic Web and Semantic Web services, biology, and many other domains are readily applicable here and would help address some of the challenges in the cloud space.


Opportunities for Semantic Models in Cloud Computing
Semantic models are helpful in three aspects of cloud computing.The first is functional and nonfunctional definitions. The ability to define application functionality and quality-of-service details in a platform-agnostic manner can immensely benefit the cloud community. This is particularly important for porting application code horizontally—that is, across silos. Lightweight semantics, which we describe in detail later, are particularly applicable. The second aspect is data modeling. A crucial difficulty developers face is porting data horizontally across clouds. For example, moving data from a schema-less data store (such as Google Bigtable1) to a schema-driven data store such as a relational database presents a significant challenge. For a good overview of this concern, see the discussion of customer scenarios in the Cloud Computing User Cases White Paper. The root of this difficulty is the lack of a platform-agnostic data model. Semantic modeling of data to provide a platform-independent data representation would be a major advantage in the cloud space. The third aspect is service description enhancement. Clouds expose their operations via Web services, but these service interfaces differ between vendors. The operations’ semantics, however, are similar. Metadata added through annotations pointing to generic operational models would play a key role in consolidating these APIs and enable interoperability among the heterogeneous cloud environments.

Functional Portability
From a perspective of the cloud landscape based on the language abstraction and type of semantics (that is, viewing the cube in Figure 2 from the top), we see that opportunities exist to use semantic models to define applications’ functional aspects in a platform-agnostic manner. In most cases, however, converting a high-level model directly to executable artifacts pollutes both representations. Intermediate representations are important to provide a convenient conversion. Applying high-level modeling to describe an application’s functional aspects isn’t new. Many software development companies have been using UML to model application functionality at a high level and use artifacts derived from these models to drive development. This process is commonly called model-driven development. This is an example of using high-level models to derive fine-grain artifacts. UML models usually don’t include code, so you can use them only to generate a skeletal application. That is, low-level details are deliberately kept away from the high-level models. UML models, however, are inherently bound with object-oriented languages, and UML- driven development processes depend heavily on advanced tools (for example, IBM’s Rational Rose). This limits UML’s applicability. A popular alternative to such tool-dependent heavy upfront models is domain-specific languages (DSLs). Their popularity is due partly to the availability of extensible interpreted programming languages such as Ruby and Python. Unlike UML, a DSL is applicable only in a given domain but enables a light-weight model in that domain, often without requiring proprietary tools. For example, you can use IBM’s Sharable Code DSL (ISC), which is a mashup generator, with a basic text editor. (However, providing graphical abstractions and specialized tooling would be more convenient for users.) “Lightweight” signifies that these models don’t use rich knowledge representation languages and so have limited reasoning capabilities. Our Cirrocumulus project for cloud interoperability (Cirrocumulus) uses DSLs to bridge the gap between executable artifacts and high-level semantic models. A DSL, although domain specific, can provide a more programmer-oriented representation of functional, non-functional, or even data descriptions. A best-of-both-worlds approach is to use annotations to link models, which provides the convenience of lightweight models while supporting high-level operations when required. Figure 2 shows an annotation referring to an ontology from a fictitious DSL script for configuration. The script is more programmer-oriented (in fact, it’s derived from Ruby) but lacks an ontology’s richness. However, the annotation links the relevant components between the different levels, providing a way to facilitate high-level operations while maintaining a simpler representation. From the perspective based on the type of semantics and software lifecycle stage—that is, looking at the cube in Figure 1 from the front — you can see the modeling coverage for software deployment and management. Elastra’s Elastic Computing Modeling Language (ECML),

Chart2.png

Elastic Deployment Modeling Language (EDML), and Elastic Management Modeling Language (EMML) ontologies cover many system aspects and some nonfunctional aspects in all stages. We’re pleased to see such industry initiative in adopting semantic technologies.

Data Modeling

Another opportunity for semantic models for clouds lies in Resource Description Framework (RDF) data modeling. As we discussed in part 1, a major concern plaguing cloud computing’s adoption is data lock-in , that is, the inability to port data horizontally. Many vendors designed schema-less, distributed data stores with relaxed consistency models to provide high availability and elasticity to suit clouds’ needs. However,

Chart3.png

exploiting these data stores requires substantial redesign of many data-driven applications and often makes porting data to a traditional relational database extremely difficult. The current practice is to address such transitions case-by-case. A better approach is to model the data in RDF and generate the specific target representations, and in some cases even the code for the application’s data access layer. This method can formulate transformations from one representation to another using the lifting-lowering mechanism. Semantic Annotations for WSDL and XML Schema (SAWSDL) demonstrated this mechanism’s use for data mediation.

Lightweight modeling in terms of DSLs also applies here. For example, the Web services community has long used XML Schema definitions as platform-agnostic data definitions. Schema definitions serve as inputs to code generation tools that generate platform-specific data definitions. From the perspective of the type of semantics and software lifecycle stage, most of this data modeling applies during application development. Concrete artifacts generated from these high-level models would be used mostly during subsequent lifecycle stages. One feature differentiating the cloud from other distributed environments is the availability of Web services to manipulate resources. Availability of the service APIs lets you programmatically manage the cloud resources, even from within the same cloud. These capabilities have revolutionized application deployment and management. For example, you can compose or mash up well-defined services to facilitate elaborate workflows. Service definitions are usually syntactic, and many researchers have focused on embedding rich metadata in formal service descriptions. One result of this research is SAWSDL. A growing trend is to annotate HTML descriptions to embed richer, machine-readable semantic metadata. One reason for this method’s popularity is search engines’ use of metadata to display results in customized formats. Yahoo’s SearchMonkey and Google Rich Snippets are two such microformat-driven schemes. These annotations, unlike the DSL annotations in Figure 3, might not always point to ontologies. Their structure can be based on a vocabulary or taxonomy— a lower-grade nonsemantic model. For example, the popular hCalendar microformat is part of the “lowercase semantic web” movement, which emphasizes lightweight models. Embedding rich semantic meta-data in cloud service descriptions has three main benefits that go beyond customized search capabilities. The first benefit deals with Representational State Transfer (REST) style services. Many cloud service providers adopt REST-style Web services that don’t advocate a formal service description. These services are described using HTML pages. WSDL 2.0, the latest specification, explicitly supports formal description of “RESTful” services but hasn’t seen quick adoption. Alternative approaches such as SA-REST(SA stands for semantic annotation), a generic annotation scheme that follows microformat design principles, are becoming more applicable in this space. These annotations enable the seamless, flexible integration of formalizations into RESTful service descriptions. This opens the door to many exciting avenues such as faceted search to identify relevant reusable services and semiautomated service compositions. The second benefit deals with handling change. The cloud space is still evolving. If the history of software or component interoperability is any guide, achieving consensus in the cloud space will be difficult and won’t likely happen soon. Attaching formalizations via annotations, however, is flexible enough to accommodate an evolving model. This is especially attractive to vendors who aren’t willing to invest heavily in interim standards. The third benefit is that the formalizations apply not only to service descriptions but also to many other aspects such as service level agreements (SLAs) and software licenses. You can use annotations to embed formalizations even for these documents, facilitating more automation in the cloud space. For example, Web Service Level Agreement (WSLA) specification provides a way to formalize SLAs, but creating and maintaining these formalizations is timeconsuming. Figure 3 illustrates using SA-REST annotations on the Amazon Elastic Compute Cloud (EC2) SLA document. It shows how a capable processor could use these annotations to extract a WSLA equivalent of the human readable SLA. These benefits’ importance comes into perspective when you consider the enormous body of research on standard-driven service compositions and agreement matching. The informal, non-standard-driven nature of many cloud services made most of the previous research inapplicable. However, being able to glean formalizations from existing documents opens the doors to apply many well-researched techniques.

The cloud space presents many opportunities for researchers, and we see a plethora of applications that use semantic modeling. Issues such as interoperability and data portability, which the cloud community is facing right now, are the very issues for which semantic models excel in providing solutions. However, learning from the past, we advocate a multilevel modeling strategy to provide smooth transitions into different granularity levels. We also think that DSLs can play an important role in the cloud space to provide lightweight modeling in an appealing manner to the software engineering community.

References
1. C. Thomas et al., “Growing Fields of Interest—Using an Expand and Reduce Strategy for Domain Model Extraction,”Proc.­ 2008­ Int’l­ Conf.­ Web­ Intelligence­ and­ Intelligent­ Agent­ Technology (WI-IAT 08), vol. 1, IEEE CS Press, 2008, pp. 496–502.

2. K. Sivashanmugam et al., “Adding Semantics to Web Services Standards,” Proc.­Int’l­Conf.­Web­Services (ICWS 03), CSREA Press, 2003, pp. 395–401.

3. F. Chang et al., “Bigtable: A Distributed Storage System for Structured Data,” in Proc. Usenix Symp. Operating Systems Design and Implementation, Usenix Assoc., 2006, p. 15.

4. M. Nagarajan et al., “Semantic Interoper- ability of Web Services—Challenges and Experiences,” Proc. 2006 IEEE Int’l Conf. Web Services (ICWS 06), IEEE CS Press, 2006, p. 373–382.

5. A.P. Sheth, K. Gomadam, and J. Lathem, “SA-REST: Semantically Interoperable and Easier-to-Use Services and Mashups,” IEEE Internet Computing, vol. 11, no. 6, 2007, pp. 91–94.

Amit Sheth is the director of the Ohio Center of Excellence on Knowledge-Enabled Computing (Kno.e.sis) at Wright State University. He’s also the university’s LexisNexis Ohio Eminent Scholar. He’s on the Web at http://knoesis.org/amit/.

Ajith Ranabahu is pursuing a PhD in cloud- computing interoperability at Wright State University. He worked with IBM on Sharable Code and its Altocumulus project, and he coordinates the Cirrocumulus project (Cirrocumulus). Contact him at ajith@knoesis.org