Add pending transaction handling and duplicate reconciliation logic (#602)

* Add pending transaction handling and duplicate reconciliation logic

- Implemented logic to exclude pending transactions from budgets and analytics calculations.
- Introduced mechanisms for reconciling pending transactions with posted versions.
- Added duplicate detection with support for merging or dismissing matches.
- Updated transaction search filters to include a `status_filter` for pending/confirmed transactions.
- Introduced UI elements for reviewing and resolving duplicates.
- Enhanced `ProviderSyncSummary` with stats for reconciled and stale pending transactions.

* Refactor translation handling and enhance transaction and sync logic

- Moved hardcoded strings to locale files for improved translation support.
- Refined styling for duplicate transaction indicators and sync summaries.
- Improved logic for excluding stale pending transactions and updating timestamps on batch exclusion.
- Added unique IDs to status filters for better element targeting in UI.
- Optimized database queries to avoid N+1 issues in stale pending calculations.

* Add sync settings and enhance pending transaction handling

- Introduced a new "Sync Settings" section in hosting settings with UI to toggle inclusion of pending transactions.
- Updated handling of pending transactions with improved inference logic for `posted=0` and `transacted_at` in processors.
- Added priority order for pending transaction inclusion: explicit argument > environment variable > runtime configurable setting.
- Refactored settings and controllers to store updated sync preferences.

* Refactor sync settings and pending transaction reconciliation

- Extracted logic for pending transaction reconciliation, stale exclusion, and unmatched tracking into dedicated methods for better maintainability.
- Updated sync settings to infer defaults from multiple provider environment variables (`SIMPLEFIN_INCLUDE_PENDING`, `PLAID_INCLUDE_PENDING`).
- Refined UI and messaging to handle multi-provider configurations in sync settings.

# Conflicts:
#	app/models/simplefin_item/importer.rb

* Debounce transaction reconciliation during imports

- Added per-run reconciliation debouncing to prevent repeated scans for the same account during chunked history imports.
- Trimmed size of reconciliation stats to retain recent details only.
- Introduced error tracking for reconciliation steps to improve UI visibility of issues.

* Apply ABS() in pending transaction queries and improve error handling

- Updated pending transaction logic to use ABS() for consistent handling of negative amounts.
- Adjusted amount bounds calculations to ensure accuracy for both positive and negative values.
- Refined exception handling in `merge_duplicate` to log failures and update user alert.
- Replaced `Date.today` with `Date.current` in tests to ensure timezone consistency.
- Minor optimization to avoid COUNT queries by loading limited records directly.

* Improve error handling in duplicate suggestion and dismissal logic

- Added exception handling for `store_duplicate_suggestion` to log failures and prevent crashes during fuzzy/low-confidence matches.
- Enhanced `dismiss_duplicate` action to handle `ActiveRecord::RecordInvalid` and display appropriate user alerts.

---------

Co-authored-by: Josh Waldrep <joshua.waldrep5+github@gmail.com>

test/models/simplefin_entry/processor_test.rb

@@ -29,8 +29,8 @@ class SimplefinEntry::ProcessorTest < ActiveSupport::TestCase
       payee: "Pizza Hut",
       description: "Order #1234",
       memo: "Carryout",
-      posted: Date.today.to_s,
-      transacted_at: (Date.today - 1).to_s,
+      posted: Date.current.to_s,
+      transacted_at: (Date.current - 1).to_s,
       extra: { category: "restaurants", check_number: nil }
     }
 
@@ -64,7 +64,7 @@ class SimplefinEntry::ProcessorTest < ActiveSupport::TestCase
       description: "Latte",
       memo: "Morning run",
       posted: nil,
-      transacted_at: (Date.today - 3).to_s
+      transacted_at: (Date.current - 3).to_s
     }
 
     SimplefinEntry::Processor.new(tx, simplefin_account: @simplefin_account).process
@@ -77,8 +77,8 @@ class SimplefinEntry::ProcessorTest < ActiveSupport::TestCase
 
   test "captures FX metadata when tx currency differs from account currency" do
     # Account is USD from setup; use EUR for tx
-    t_date = (Date.today - 5)
-    p_date = Date.today
+    t_date = (Date.current - 5)
+    p_date = Date.current
 
     tx = {
       id: "tx_fx_1",
@@ -106,8 +106,8 @@ class SimplefinEntry::ProcessorTest < ActiveSupport::TestCase
       payee: "Test Store",
       description: "Auth",
       memo: "",
-      posted: Date.today.to_s, # provider says pending=true should still flag
-      transacted_at: (Date.today - 1).to_s,
+      posted: Date.current.to_s, # provider says pending=true should still flag
+      transacted_at: (Date.current - 1).to_s,
       pending: true
     }
 
@@ -120,7 +120,7 @@ class SimplefinEntry::ProcessorTest < ActiveSupport::TestCase
 
   test "posted==0 treated as missing, entry uses transacted_at date and flags pending" do
     # Simulate provider sending epoch-like zeros for posted and an integer transacted_at
-    t_epoch = (Date.today - 2).to_time.to_i
+    t_epoch = (Date.current - 2).to_time.to_i
     tx = {
       id: "tx_pending_zero_posted_1",
       amount: "-6.48",
@@ -141,4 +141,26 @@ class SimplefinEntry::ProcessorTest < ActiveSupport::TestCase
     sf = entry.transaction.extra.fetch("simplefin")
     assert_equal true, sf["pending"], "expected pending flag to be true when posted==0 and/or pending=true"
   end
+
+  test "infers pending when posted is explicitly 0 and transacted_at present (no explicit pending flag)" do
+    # Some SimpleFIN banks indicate pending by sending posted=0 + transacted_at, without pending flag
+    t_epoch = (Date.current - 1).to_time.to_i
+    tx = {
+      id: "tx_inferred_pending_1",
+      amount: "-15.00",
+      currency: "USD",
+      payee: "Gas Station",
+      description: "Fuel",
+      memo: "",
+      posted: 0,
+      transacted_at: t_epoch
+      # Note: NO pending flag set
+    }
+
+    SimplefinEntry::Processor.new(tx, simplefin_account: @simplefin_account).process
+
+    entry = @account.entries.find_by!(external_id: "simplefin_tx_inferred_pending_1", source: "simplefin")
+    sf = entry.transaction.extra.fetch("simplefin")
+    assert_equal true, sf["pending"], "expected pending to be inferred from posted=0 + transacted_at present"
+  end
 end