Delete column and the row if there is a duplicate value in the other column

I have the below data (around 50000 rows):

Symbol, Data, Time, Price, Volume
CLF7,01/03/1996,12:54:04,17.58,0
CLF7,01/03/1996,13:31:19,17.57,0
CLF7,01/03/1996,15:07:42,17.57,0
CLF7,01/03/1996,15:07:45,17.54,0
CLF7,01/03/1996,15:10:03,17.12,0
CLF7,01/03/1996,12:54:04,17.12,0
CLF7,01/03/1996,13:27:39,17.54,0
CLF7,01/03/1996,14:35:40,17.57,0
CLF7,02/03/1996,12:54:04,17.57,0
CLF7,02/03/1996,13:31:19,17.57,0
CLF7,02/03/1996,15:07:42,17.54,0
CLF7,02/03/1996,15:07:45,17.54,0
CLF7,02/03/1996,15:10:03,17.12,0
CLF7,02/03/1996,12:54:04,17.12,0
CLF7,02/03/1996,13:27:39,17.54,0
CLF7,02/03/1996,14:35:40,17.57,0

Could you give some advice for my require: Delete the column 5. I already tried the below code, but it is not efficient

for
  data(:,5)=[];
end

In the column Price, if the line of succession has duplicated values, I want to keep the last row. It means I need the data as follows:

Symbol, Data, Time, Price, Volume
CLF7,01/03/1996,12:54:04,17.58
CLF7,01/03/1996,15:07:42,17.57
CLF7,01/03/1996,15:07:45,17.54
CLF7,01/03/1996,12:54:04,17.12
CLF7,01/03/1996,13:27:39,17.54
CLF7,02/03/1996,13:31:19,17.57
CLF7,02/03/1996,15:07:45,17.54
CLF7,02/03/1996,12:54:04,17.12
CLF7,02/03/1996,13:27:39,17.54
CLF7,02/03/1996,14:35:40,17.57

Thanks for your help.

Answer 1

[the cyclist]

Here's one way:

% Some pretend data
R = round(rand(6,5));

% Remove 5th column -- There is no more efficient way, and this should be very fast
R(:,5) = [];

% Identify repeated values
repeatValueRowToKeep = [find(diff(R(:,4))~=0); size(R,1)];

% Keep only that last row
R = R(repeatValueRowToKeep,:);

[Trung Hieu Le]

Could you help me check it? I already tried data1996(:,5)=[]; However, It deletes the row instead of the column. I also did with sample pretend data. It is efficiency with the table. Could you help me take a look at the attached picture? In addition, when I run the below codes, it shows the error as follows: Error using diff Function 'diff' is not supported for class 'struct'.

Thanks

[Trung Hieu Le]

I already deleted the column volume with the below code:

hasField = isfield(data, 'Volume'); 
if hasField
    data = rmfield(data, 'Volume');
end

[the cyclist]

I think the most important thing I can mention now is that you really should have given all this information to begin with. You would have saved all of us a lot of time.

I can't look at this at the moment. Maybe later.

[Image Analyst]

The comments on that are all messed up. You botched the adaption of the code. You're confusing volume and data. It should look like

% Try to remove the field called Volume, if there is one.
% First see if there is a field of "data" called "Volume".
hasField = isfield(data, 'Volume'); % Will be True or False.
% Now remove it if it's there.
if hasField
    % The Volume field is there.  Remove it.
    data = rmfield(data, 'Volume');
else
    % The Volume field is not there -- warn the user.
    warningMessage = sprintf('Warning: the structure "data"\ndoes not have a field called "Volume."');
    uiwait(warndlg(warningMessage));
end

[Juan Zambrano]

Amazing!!! Thank You Very Much. @the cyclist

Answer 2

[Image Analyst]

You say "Delete column and the row if there is a duplicate value in the other column" but I don't see in your example how any column was removed. There are still 5 columns.

Is your data a cell array or a table? Assuming it's a table, I think you can delete rows where columns match like this example

col2 = t{:, 2}  % Extract column 2.
col3 = t{:, 3}  % Extract column 3.
% Find where col 2 = col 3
duplicateRows = col2 == col3;
% Remove those rows where column 2 = column 3
t(duplicateRows, :) = [];  % Setting whole row to null removes the row.

(Note, this is untested, just off the top of my head).

[Trung Hieu Le]

Sorry. I just edit the output data. It shall be deleted the column 5. My data is an array. I just take care about the column 4. I expect to find the continuously duplicated price and keep the last value. I tried with below code, but it does not work:

    dim = size(data);
data_3 = zeros(dim); 
i = 1; j = 1;
data_3(i,:) = data(i,:); 
for i=2:dim(1)
    if data(i,4) != data(i-1, 4) 
       j = j+1;
       data_3(j,:) = data(i,:); 
    end
end
data_4 = data_3([1:j], :);

Do you have any idea about my code?

Thanks