There are two types of HTML tables published on the web-

  1. Static tables: Data is static i.e. Number of rows and columns are fixed.
  2. Dynamic tables: Data is dynamic i.e. Number of rows and columns are NOT fixed.

Below is an example of a dynamic table of Sales. Based on input date filters, number of rows will get altered. So, it is dynamic in nature.

Handling static table is easy, but dynamic table is a little bit difficult as rows and columns are not constant.

In this tutorial, you will learn-

Using X-Path to Locate Web Table Elements

Before we locate web element, first let's understands-

What is a web element?

Web elements are nothing but HTML elements like textbox, dropdowns radio buttons, submit buttons, etc. These HTML elements are written with start tag and ends with an end tag.

For Example,

<p> My First HTML Document</p>.

Steps for getting X-path of web element that we want to locate.

Step 1) In Chrome, Go to http://money.rediff.com/gainers/bsc/daily/groupa

Step 2) Right click on web element whose x-path is to be fetched. In our case, right click on "Company" Select Inspect option. The following screen will be shown -

Step 3) Right Click on highlighted web element > Select Copy -> Copy x-path option.

Step 4) Use the copied X-path "//*[@id="leftcontainer"]/table/thead/tr/th [1]" in Selenium WebDriver to locate the element.

Example: Fetch number of rows and columns from Dynamic WebTable

When the table is dynamic in nature, we cannot predict its number of rows and columns.

Using Selenium web driver, we can find

  • Number of Rows and columns of web table
  • X row or Y column's data.

Below is program for fetching total number of rows and columns of web table.

import java.text.ParseException;
import java.util.List;
import org.openqa.selenium.By;
import org.openqa.selenium.WebDriver;
import org.openqa.selenium.WebElement;
import org.openqa.chrome.ChromeDriver;
public class Noofrowsandcols {
    public static void main(string[] args) throws ParseException {
        WebDriver wd;
        System.setProperty("webdriver.chrome.driver", "D:\\ chromedriver.exe") ;
        wd = new ChromeDriver();
        wd.get("http://money.rediff.com/gainers/bsc/dailygroupa?");         
        //No.of Columns
        List <WebElement> col = wd.findElements(By.xpath(".//*@id="leftcontainer']/table/thead/tr/th"));
        System.out.println("No of cols are : " +col.size()); 
        //No.of rows 
        List <WebElement> rows = wd.findElements(By.xpath(".//*[@id="leftcontainer']/table/tbody/tr/td[1]")); 
        System.out.println("No of rows are : " + rows.size());
        wd.close();
    }
}

Code Explanation:

  • Here we have first declared Web Driver object "wd" &initialized it to chrome driver.
  • We use List <WebElement> to total number of columns in "col".
  • findElements commands returns a list of ALL the elements matching the specified locator
  • using findElements and X-path //*@id="leftcontainer']/table/thead/tr/th")); we get all the columns
  • Similarly, we repeat the process for rows.

.

Output:

Example: Fetch cell value of a particular row and column of the Dynamic Table

Let's assume we need 3rd row of the table and its second cell's data. See the table below-

In above table, data is regularly updated after some span of time. The data you try retrieve will be different from the above screenshot. However, the code remains the same. Here is sample program to get the 3rd row and 2nd column's data.

import java.util.concurrent.TimeUnit; 
public class Randomrowandcell { 
    public static void main (String[] args)
{
    WebDriver wd;
    System.setProperty ("webdriver.chrome.driver", "D:\\Guru 99 Tech writing\\Guru99 Examples\\chromedriver.exe") ;
    wd = new ChromeDriver();
    wd.get("http://money.rediff.com/gainers/bsc/daily/groupa?"); 
     wd.manage().timeouts().implicitlyWait(20, TimeUnit.SECONDS);
    WebElement baseTable = wd.findElement(By.tagName("table"));
    
    //To fimd third row of table
    WebElement tableRow = baseTable.findElement(By.xpath("//*[@id='leftcontainer']/table/tbody/tr[3]"));
    
    WebElement tableRowText = baseTable.findElement(By.xpath ("//*[@id='left container']/table/tbody/tr[3]/td[1]"));
    
    String rowtext = tableRow.getText();
    System.out.println("Third row of table : "+rowtext);
    
    //to get 3rd row's 2nd column data
    WebElement cellIneed = tableRow.findElement(By.xpath("//*[@id='leftcontainer']/table/tbody/tr[3]/td[2]"));
    String valueIneed = cellIneed.getText();
    System.out.println("Cell value is : " + valueIneed); 
    wd.close();
}    //*[@id='leftcontainer']/table/tbody/tr[3]
}

Code Explanation:

  • Table is located using locator property "tagname".
  • Using Xpath "//*[@id = 'leftcontainer']/table/tbody/tr [3]/td [1]" find the 3rd row and gets its text using getText () function
  • Using Xpath "//*@id ='leftcontainer'/table/tbody/tr[3]/td[2]" find the 2nd cell in 3rd row and gets its text using getText () function

Output:

Example: Get Maximum of all the Values in a Column of Dynamic Table

In this example, we will get the maximum of all values in a particular column.

Refer the following table -

Here is the code

import java.text.NumberFormat;
public class maximumfromtable {
    public static void main (string[] args) throws ParseException { 
        string max;
        double m=0,r=0;
        WebDriver wd; 
        System.setProperty("webdriver.chrome.driver", "D:\\chromedriver.exe");
        wd = new ChromeDriver();
        wd.get("http://money.rediff.com/gainers/bsc/daily/groupa?");
        //No. of Columns
        List <WebElement> col = wd.findElements(By.xpath(".//*[@id='leftcontainer']/table/thead/tr/th"));
        System.out.println("Total No of columns are : " +col.size());
        //No.of rows
        List <WebElement> rows = wd.findElements(By.xpath (".//*[@id='leftcontainer']/table/tbody/tr/td[1]"));
        System.out.println("Total No of rows are : " + rows.size());
        for (int i =1;i<rows.size();i++)
        {    
            max= wd.findElement(By.xpath("html/body/div[1]/div[5]/table/tbody/tr[" + (i+1)+ "]/td[4]")).getText();
            NumberFormat f =NumberFormat.getNumberInstance(); 
            Number num = f.parse(max);
            max = num.toString();
            m = Double.parseDouble(max);
            if(m>r)
             {    
                r=m;
             }
        }
        System.out.println("Maximum current price is : "+ r);
        wd.close();
    }
}

Code Explanation:

  • Using chrome driver we locate the web table and get total number of row using XPath ".//*[@id='leftcontainer']/table/tbody/tr/td[1]"
  • Using for loop, we iterate through total number of rows and fetch values one by one. To get next row we use (i+1) in XPath
  • We compare old value with new value and maximum value is printed at the end of for loop

OutPut

Example: Get all the values of a Dynamic Table

Consider the following table http://demo.guru99.com/selenium/table/

The number of columns for each row is different.

Here row number 1, 2 and 4 have 3 cells, and row number 3 has 2 cells, and row number 5 has 1 cell.

We need to get values of all the cells

Here is the code:

import java.util.List;
public class dynamic_table_data_extract { 

public static void main(String args[])
{
WebDriver wd; 
System.setProperty("webdriver.chrome.driver", "D:\\ chromedriver.exe");
wd = new ChromeDriver();
wd.manage().window().maximize();
wd.manage().timeouts().implicitlyWait(5, TimeUnit.SECONDS);
wd.get("http://demo.guru99.com/selenium/table/");
//To locate table.
WebElement mytable = wd.findElement(By.xpath("/html/body/table/tbody"));
//To locate rows of table. 
List<WebElement> rows_table = mytable.findElements(By.tagName("tr"));
//To calculate no of rows In table.
int rows_count = rows_table.size();
//Loop will execute till the last row of table.
for (int row=0; row<rows_count; row++){ 
//To locate columns(cells) of that specific row.
List<WebElement> Columns_row = rows_table.get(row).findElements(By.tagName("td")); 
//To calculate no of columns (cells). In that specific row.
int columns_count = Columns_row.size();
System.out.println("Number of cells In Row "+row+" are "+columns count);
//Loop will execute till the last cell of that specific row.
for (int column=0; column<columns_count; column++){ 
// To retrieve text from that specific cell.
String celtext = Columns_row.get(column).getText();
System.out.println("Cell Value of row number "+row+" and column number "+column+" Is "+celtext);
}
System.out.println("-------------------------------------------------- ");
}
}
}

Code Explanation:

  • rows_count gives the total number of rows
  • for each row we get the total number of columns using rows_table.get(row).findElements(By.tagName("td"));
  • We iterate through each column and of each row and fetch values.

Output:

Summary

  • Static web tables are consistent in nature. i.e. they do have fixed number of rows as well as Cell data.
  • Dynamic web tables are inconsistent i.e. they do not have fixed number of rows and cells data.
  • Using selenium web driver, we can handle dynamic web tables easily.
  • Selenium Webdriver allows us to access dynamic web tables by their X-path

The article is contributed by Kanchan Kulkarni.