title: Cut-FUNQUE: An Objective Quality Model for Compressed Tone-Mapped High Dynamic Range Videos

abstract: High Dynamic Range (HDR) videos have enjoyed a surge in popularity in recent years due to their ability to represent a wider range of contrast and color than Standard Dynamic Range (SDR) videos. Although HDR video capture has seen increasing popularity because of recent flagship mobile phones such as Apple iPhones, Google Pixels, and Samsung Galaxy phones, a broad swath of consumers still utilize legacy SDR displays that are unable to display HDR videos. As result, HDR videos must be processed, i.e., tone-mapped, before streaming to a large section of SDR-capable video consumers. However, server-side tone-mapping involves automating decisions regarding the choices of tone-mapping operators (TMOs) and their parameters to yield high-fidelity outputs. Moreover, these choices must be balanced against the effects of lossy compression, which is ubiquitous in streaming scenarios. In this work, we develop a novel, efficient model of objective video quality named Cut-FUNQUE that is able to accurately predict the visual quality of tone-mapped and compressed HDR videos. Finally, we evaluate Cut-FUNQUE on a large-scale crowdsourced database of such videos and show that it achieves state-of-the-art accuracy.


title: Separation of variables for Hitchin systems with the structure group $SO(4)$, on genus two curves

abstract: Sets of points giving spectral curves can be regarded as phase coordinates of Hitchin systems. We address the problem of finding out trajectories of Hitchin systems in those coordinates. The problem is being solved for the systems with structure groups $SO(4)$ and $SL(2)$ on genus 2 curves. Our method is a transfer of straight line windings of fibers of the Hitchin map, which are given by Prymians of the spectral curves for the systems with simple classical structure groups. The transfer is carried out by means of an analog of the Jacobi inversion map, which does not exist for Prymians in general but can be defined in the two cases in question.


title: Revolutionizing System Reliability: The Role of AI in Predictive Maintenance Strategies

abstract: The landscape of maintenance in distributed systems is rapidly evolving with the integration of Artificial Intelligence (AI). Also, as the complexity of computing continuum systems intensifies, the role of AI in predictive maintenance (Pd.M.) becomes increasingly pivotal. This paper presents a comprehensive survey of the current state of Pd.M. in the computing continuum, with a focus on the combination of scalable AI technologies. Recognizing the limitations of traditional maintenance practices in the face of increasingly complex and heterogenous computing continuum systems, the study explores how AI, especially machine learning and neural networks, is being used to enhance Pd.M. strategies. The survey encompasses a thorough review of existing literature, highlighting key advancements, methodologies, and case studies in the field. It critically examines the role of AI in improving prediction accuracy for system failures and in optimizing maintenance schedules, thereby contributing to reduced downtime and enhanced system longevity. By synthesizing findings from the latest advancements in the field, the article provides insights into the effectiveness and challenges of implementing AI-driven predictive maintenance. It underscores the evolution of maintenance practices in response to technological advancements and the growing complexity of computing continuum systems. The conclusions drawn from this survey are instrumental for practitioners and researchers in understanding the current landscape and future directions of Pd.M. in distributed systems. It emphasizes the need for continued research and development in this area, pointing towards a trend of more intelligent, efficient, and cost-effective maintenance solutions in the era of AI.


title: Adiabatic Approximation and Aharonov-Casher Bands in Twisted Homobilayer TMDs

abstract: Topological flat moir\'e bands with nearly ideal quantum geometry have been identified in homobilayer transition metal dichalcogenide moir\'e superlattices, and are thought to be crucial for understanding the fractional Chern insulating states recently observed therein. Previous work proposed viewing the system using an adiabatic approximation that replaces the position-dependence of the layer spinor with a nonuniform periodic effective magnetic field. When the local zero-point kinetic energy of this magnetic field cancels identically against that of an effective Zeeman energy, a Bloch-band version of Aharonov-Casher zero-energy modes, which we refer to as Aharonov-Casher band, emerges leading to ideal quantum geometry. Here, we critically examine the validity of the adiabatic approximation and identify the parameter regimes under which Aharonov-Casher bands emerge. We show that the adiabatic approximation is accurate for a wide range of parameters including those realized in experiments. Furthermore, we show that while the cancellation leading to the emergence of Aharonov-Casher bands is generally not possible beyond the leading Fourier harmonic, the leading harmonic is the dominant term in the Fourier expansions of the zero-point kinetic energy and Zeeman energy. As a result, the leading harmonic expansion accurately captures the trend of the bandwidth and quantum geometry, though it may fail to quantitatively reproduce more detailed information about the bands such as the Berry curvature distribution.


title: Real-Time Safe Control of Neural Network Dynamic Models with Sound Approximation

abstract: Safe control of neural network dynamic models (NNDMs) is important to robotics and many applications. However, it remains challenging to compute an optimal safe control in real time for NNDM. To enable real-time computation, we propose to use a sound approximation of the NNDM in the control synthesis. In particular, we propose Bernstein over-approximated neural dynamics (BOND) based on the Bernstein polynomial over-approximation (BPO) of ReLU activation functions in NNDM. To mitigate the errors introduced by the approximation and to ensure persistent feasibility of the safe control problems, we synthesize a worst-case safety index using the most unsafe approximated state within the BPO relaxation of NNDM offline. For the online real-time optimization, we formulate the first-order Taylor approximation of the nonlinear worst-case safety constraint as an additional linear layer of NNDM with the l2 bounded bias term for the higher-order remainder. Comprehensive experiments with different neural dynamics and safety constraints show that with safety guaranteed, our NNDMs with sound approximation are 10-100 times faster than the safe control baseline that uses mixed integer programming (MIP), validating the effectiveness of the worst-case safety index and scalability of the proposed BOND in real-time large-scale settings. The code is available at https://github.com/intelligent-control-lab/BOND.


title: What can Hurricane SAM (2021) tell us about ocean waves under tropical cyclones?

abstract: We investigate the ocean wave field under Hurricane SAM (2021). Whilst measurements of waves under Tropical Cyclones (TCs) are rare, an unusually large number of quality in situ and remote measurements are available in that case. First, we highlight the good consistency between the wave spectra provided by the Surface Waves Investigation and Monitoring (SWIM) instrument onboard the China-France Oceanography Satellite (CFOSAT), the in situ spectra measured by National Data Buoy Center (NDBC) buoys, and a saildrone. The impact of strong rains on SWIM spectra is then further investigated. We show that whereas the rain definitely affects the normalized radar cross section, both the innovative technology (beam rotating scanning geometry) and the post-processing processes applied to retrieve the 2D wave spectra ensure a good quality of the resulting wave spectra, even in heavy rain conditions. On this basis, the satellite, airborne and in situ observations are confronted to the analytical model proposed by Kudryavtsev et al (2015). We show that a trapped wave mechanism may be invoked to explain the large significant wave height observed in the right front quadrant of Hurricane SAM.


title: Generalization of Task Parameterized Dynamical Systems using Gaussian Process Transportation

abstract: Learning from Interactive Demonstrations has revolutionized the way non-expert humans teach robots. It is enough to kinesthetically move the robot around to teach pick-and-place, dressing, or cleaning policies. However, the main challenge is correctly generalizing to novel situations, e.g., different surfaces to clean or different arm postures to dress. This article proposes a novel task parameterization and generalization to transport the original robot policy, i.e., position, velocity, orientation, and stiffness. Unlike the state of the art, only a set of points are tracked during the demonstration and the execution, e.g., a point cloud of the surface to clean. We then propose to fit a non-linear transformation that would deform the space and then the original policy using the paired source and target point sets. The use of function approximators like Gaussian Processes allows us to generalize, or transport, the policy from every space location while estimating the uncertainty of the resulting policy due to the limited points in the task parameterization point set and the reduced number of demonstrations. We compare the algorithm's performance with state-of-the-art task parameterization alternatives and analyze the effect of different function approximators. We also validated the algorithm on robot manipulation tasks, i.e., different posture arm dressing, different location product reshelving, and different shape surface cleaning.


title: Stellar Abundances at the Center of Early Type Galaxies with Fine Structure

abstract: Our understanding of early-type galaxies (ETGs) has grown in the past decade with the advance of full-spectrum fitting techniques used to infer the properties of the stellar populations that make-up the galaxy. We present ages, central velocity dispersions, and abundance ratios relative to Fe of C, N, O, Mg, Si, Ca, Ti, Cr, Mn, Co, Ni, Cu, Sr, Ba, and Eu, derived using full-spectrum fitting techniques for three ETGs NGC 2865, NGC 3818, and NGC 4915. Each of these three galaxies were selected because they have optical, disturbed structures (fine structure) that are linked to major merger events that occurred 1, 7, and 6 Gyr ago, respectively. Two of the ETGs, NGC 3818 and NGC 4915, show chemical signatures similar to ETGs without fine structure, which is consistent with a gas-poor merger of elliptical galaxies in which substantial star formation is not expected. For NGC 2865, we find a statistically higher abundance of Ca (an $\alpha$-element) and Cr and Mn (Fe-peak elements). We show that for NGC 2865, a simple gas-rich merger scenario fails to explain the larger abundance ratios compared to ETGs without fine structure. These three early-type galaxies with fine structure exhibit a range of abundances, suggesting ETGs with fine structure can form via multiple pathways and types of galaxy mergers.


title: Improving Web Content Delivery with HTTP/3 and Non-Incremental EPS

abstract: HTTP/3 marks a significant advancement in protocol development, utilizing QUIC as its underlying transport layer to exploit multiplexing capabilities and minimize head-of-line blocking. The introduction of the Extensible Prioritization Scheme (EPS) offers a signaling mechanism for controlling the order of resource delivery. In this study, we propose mappings from Chromium priority hints to EPS urgency levels with the goal of enhancing the key web performance metrics. The mappings are evaluated using EPS's urgency-based, non-incremental resource delivery method. The results of the experimental evaluation show that the proposed mappings improve the Quality of Experience metrics across a range of websites.


title: Optimal performance of a three stroke heat engine in the microscopic regime

abstract: In the microscopic regime, we consider a stroke-based heat engine that utilizes the temperature difference between two heat baths to produce work using a working body. The working body of the engine aims to extract heat from the hot heat bath, generate work, and discharge the surplus heat into the cold heat bath through the successive execution of three strokes. We discuss the thermodynamic framework for such an engine that involves any arbitrary-dimensional working body. Next, our investigation focuses on the smallest version of this engine, which involves a two-level working body, resulting in a closed expression for optimal work production and efficiency. Furthermore, we investigate the possibility of realizing such an engine within the Jaynes-Cummings model, gaining insights into optimal work production and efficiency. Finally, we scale down the engine, taking into account finite-dimensional heat baths, and obtain the expressions for optimal work and efficiency in this scenario.


title: Exploring Hybrid Work Realities: A Case Study with Software Professionals From Underrepresented Groups

abstract: Context. In the post-pandemic era, software professionals resist returning to office routines, favoring the flexibility gained from remote work. Hybrid work structures, then, become popular within software companies, allowing them to choose not to work in the office every day, preserving flexibility, and creating several benefits, including an increase in the support for underrepresented groups in software development. Goal. We investigated how software professionals from underrepresented groups are experiencing post-pandemic hybrid work. In particular, we analyzed the experiences of neurodivergents, LGBTQIA+ individuals, and people with disabilities working in the software industry. Method. We conducted a case study focusing on the underrepresented groups within a well-established South American software company. Results. Hybrid work is preferred by software professionals from underrepresented groups in the post-pandemic era. Advantages include improved focus at home, personalized work setups, and accommodation for health treatments. Concerns arise about isolation and inadequate infrastructure support, highlighting the need for proactive organizational strategies. Conclusions. Hybrid work emerges as a promising strategy for fostering diversity and inclusion in software engineering, addressing past limitations of the traditional office environment.


title: Time-Gated Optical Spectroscopy of Field-Effect Stimulated Recombination via Interfacial Point Defects in Fully-Processed Silicon Carbide Power MOSFETs

abstract: Fully-processed SiC power metal-oxide-semiconductor field-effect transistors (MOSFETs) emit light during switching of the gate terminal, while both drain and source terminals are grounded. The emitted photons are caused by defect-assisted recombination of electrons and holes at the 4H-SiC/SiO$_2$ interface and can be detected through the SiC substrate. Here, we present time-gated spectroscopic characterization of these interfacial point defects. Unlike in previous studies, the devices were opened in such a way that the drain-contact remained electrically active. A separate examination of the photons emitted at the rising and falling transitions of the gate-source voltage enabled the extraction of two different spectral components. One of these components consists of a single transition with phonon replicas of a local vibrational mode (LVM) with an astonishingly high energy of 220 meV $\unicode{x2013}$ well above the highest phonon modes in 4H-SiC and SiO$_2$ of 120 meV and 137 meV, respectively. Based on a quantum mechanical model, we successfully fitted its emission spectrum and assigned it to donor-acceptor pair recombination involving a carbon cluster-like defect. Other transitions were assigned to EH$_{6/7}$-assisted, EK$_2$-D, and nitrogen-aluminum donor-acceptor pair recombination. Due to the relevance of these defects in the operation of SiC MOSFETs, these novel insights will contribute to improved reliability and performance of these devices.


title: Paths to Testing: Why Women Enter and Remain in Software Testing?

abstract: Background. Women bring unique problem-solving skills to software development, often favoring a holistic approach and attention to detail. In software testing, precision and attention to detail are essential as professionals explore system functionalities to identify defects. Recognizing the alignment between these skills and women's strengths can derive strategies for enhancing diversity in software engineering. Goal. This study investigates the motivations behind women choosing careers in software testing, aiming to provide insights into their reasons for entering and remaining in the field. Method. This study used a cross-sectional survey methodology following established software engineering guidelines, collecting data from women in software testing to explore their motivations, experiences, and perspectives. Findings. The findings reveal that women enter software testing due to increased entry-level job opportunities, work-life balance, and even fewer gender stereotypes. Their motivations to stay include the impact of delivering high-quality software, continuous learning opportunities, and the challenges the activities bring to them. However, inclusiveness and career development in the field need improvement for sustained diversity. Conclusion. Preliminary yet significant, these findings offer interesting insights for researchers and practitioners towards the understanding of women's diverse motivations in software testing and how this understanding is important for fostering professional growth and creating a more inclusive and equitable industry landscape.


title: Do "English" Named Entity Recognizers Work Well on Global Englishes?

abstract: The vast majority of the popular English named entity recognition (NER) datasets contain American or British English data, despite the existence of many global varieties of English. As such, it is unclear whether they generalize for analyzing use of English globally. To test this, we build a newswire dataset, the Worldwide English NER Dataset, to analyze NER model performance on low-resource English variants from around the world. We test widely used NER toolkits and transformer models, including models using the pre-trained contextual models RoBERTa and ELECTRA, on three datasets: a commonly used British English newswire dataset, CoNLL 2003, a more American focused dataset OntoNotes, and our global dataset. All models trained on the CoNLL or OntoNotes datasets experienced significant performance drops-over 10 F1 in some cases-when tested on the Worldwide English dataset. Upon examination of region-specific errors, we observe the greatest performance drops for Oceania and Africa, while Asia and the Middle East had comparatively strong performance. Lastly, we find that a combined model trained on the Worldwide dataset and either CoNLL or OntoNotes lost only 1-2 F1 on both test sets.


title: A Griffith description of fracture for non-monotonic loading with application to fatigue

abstract: With the fundamental objective of establishing the universality of the Griffith energy competition to describe the growth of large cracks in solids \emph{not} just under monotonic but under general loading conditions, this paper puts forth a generalization of the classical Griffith energy competition in nominally elastic brittle materials to arbitrary \emph{non-monotonic} quasistatic loading conditions, which include monotonic and cyclic loadings as special cases. Centered around experimental observations, the idea consists in: $i$) viewing the critical energy release rate $\mathcal{G}_c$ \emph{not} as a material constant but rather as a material function of both space $\textbf{X}$ and time $t$, $ii$) one that decreases in value as the loading progresses, this solely within a small region $\Omega_\ell(t)$ around crack fronts, with the characteristic size $\ell$ of such a region being material specific, and $iii$) with the decrease in value of $\mathcal{G}_c$ being dependent on the history of the elastic fields in $\Omega_\ell(t)$. By construction, the proposed Griffith formulation is able to describe any Paris-law behavior of the growth of large cracks in nominally elastic brittle materials for the limiting case when the loading is cyclic. For the opposite limiting case when the loading is monotonic, the formulation reduces to the classical Griffith formulation. Additional properties of the proposed formulation are illustrated via a parametric analysis and direct comparisons with representative fatigue fracture experiments on a ceramic, mortar, and PMMA.


title: Optimal Feeding of Swimming and Attached Ciliates

abstract: Ciliated microorganisms near the base of the aquatic food chain either swim to encounter prey or attach at a substrate and generate feeding currents to capture passing particles. Here, we represent attached and swimming ciliates using a popular spherical model in viscous fluid with slip surface velocity that afford analytical expressions of ciliary flows. We solve an advection-diffusion equation for the concentration of dissolved nutrients, where the P'eclet number (Pe) reflects the ratio of diffusive to advective time scales. For a fixed hydrodynamic power expenditure, we ask what ciliary surface velocities maximize nutrient flux at the microorganism's surface. We find that surface motions that optimize feeding depend on Pe. For freely swimming microorganisms at finite Pe, it is optimal to swim by employing a "treadmill" surface motion, but in the limit of large Pe, there is no difference between this treadmill solution and a symmetric dipolar surface velocity that keeps the organism stationary. For attached microorganisms, the treadmill solution is optimal for feeding at Pe below a critical value, but at larger Pe values, the dipolar surface motion is optimal. We verified these results in open-loop numerical simulations, asymptotic analysis, and using an adjoint-based optimization method. Our findings challenge existing claims that optimal feeding is optimal swimming across all P'eclet numbers, and provide new insights into the prevalence of both attached and swimming solutions in oceanic microorganisms.


title: A Grassroots Architecture to Supplant Global Digital Platforms by a Global Digital Democracy

abstract: We present an architectural alternative to global digital platforms termed grassroots, designed to serve the social, economic, civic, and political needs of local digital communities, as well as their federation. Grassroots platforms may offer local communities an alternative to global digital platforms while operating solely on the smartphones of their members, forsaking any global resources other than the network itself. Such communities may form digital economies without initial capital or external credit, exercise sovereign democratic governance, and federate, ultimately resulting in the grassroots formation of a global digital democracy.


title: A stochastic differential equation approach for an SIS model with non-linear incidence rate

abstract: In this paper, we study an analytically tractable SIS model with a non-linear incidence rate for the number of infectious individuals described through a stochastic differential equation (SDE). We guarantee the existence of a positive solution, and we study its regularity. We study the persistence and extinction regimes, and we give sufficient conditions under which the disease-free equilibrium point is an asymptotically stable equilibrium point with probability one. We provide sufficient conditions under which the model admits a unique stationary measure. Finally, we illustrate our findings using simulations.


title: GWLZ: A Group-wise Learning-based Lossy Compression Framework for Scientific Data

abstract: The rapid expansion of computational capabilities and the ever-growing scale of modern HPC systems present formidable challenges in managing exascale scientific data. Faced with such vast datasets, traditional lossless compression techniques prove insufficient in reducing data size to a manageable level while preserving all information intact. In response, researchers have turned to error-bounded lossy compression methods, which offer a balance between data size reduction and information retention. However, despite their utility, these compressors employing conventional techniques struggle with limited reconstruction quality. To address this issue, we draw inspiration from recent advancements in deep learning and propose GWLZ, a novel group-wise learning-based lossy compression framework with multiple lightweight learnable enhancer models. Leveraging a group of neural networks, GWLZ significantly enhances the decompressed data reconstruction quality with negligible impact on the compression efficiency. Experimental results on different fields from the Nyx dataset demonstrate remarkable improvements by GWLZ, achieving up to 20% quality enhancements with negligible overhead as low as 0.0003x.


title: A system built for both deterministic transfer processes and contact photolithography

abstract: A home-built compact system that functions as both a transfer stage for deterministic transfer processes and a mask aligner for contact photolithography, is constructed. The precision translation and rotation sample stage and optical microscope are shared between the two modes. In the transfer mode, equipped with a heating element, the setup has been used to deterministically transfer freestanding semiconductors, 2D materials, and van der Waals electrodes. Moreover, with an upgrade cost of less than $1000, an existing transfer stage can be configured into a contact mask aligner. Photolithography patterns with feature sizes of ~1-2 um have been achieved when combining a chromium photomask and a thin photoresist layer, comparable to the performance of an entry level mask aligner such as MJB3 (Karl Suss). Our prototype instrument provides an exciting and affordable solution for preforming high quality deterministic transfer and photolithography processes on one single tool in house.


title: Foundry manufacturing of octave-spanning microcombs

abstract: Soliton microcombs provide a chip-based, octave-spanning source for self-referencing and optical metrology. We explore use of a silicon-nitride integrated photonics foundry to manufacture octave-spanning microcombs. By group-velocity dispersion engineering with the waveguide cross-section, we shape the soliton spectrum for dispersive-wave spectral enhancements at the frequencies for f-2f self-referencing. With the optimized waveguide geometry, we control the carrier-envelope offset frequency by adjusting the resonator radius. Moreover, we demonstrate the other considerations for octave microcombs, including models for soliton spectrum design, ultra-broadband resonator external coupling, low-loss edge couplers, and the nonlinear self-interactions of few-cycle solitons. This design process permits highly repeatable creation of soliton microcombs optimized for pump operation less than 100 mW, an electronically detectable offset frequency, and high comb mode power for f-2f detection. However, these design aspects must also be made compatible with the foundry fabrication tolerance of octave microcomb devices. Our experiments highlight the potential to manufacture a single-chip solution for an octave-spanning microcomb, which is the central component of a compact microsystem for optical metrology.


title: Legendrian Lavrentiev links

abstract: Lavrentiev curves form a special class of rectifiable curves which includes cusp-free piecewise smooth curves. We call a Lavrentiev curve Legendrian if the integral of the contact form equals zero on any its subarc. We define Legendrian isotopies of such curves and prove that the equivalence classes of Legendrian Lavrentiev links with respect to Legendrian isotopies coincide with smooth classes.


title: Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Models

abstract: There have recently been large advances both in pre-training visual representations for robotic control and segmenting unknown category objects in general images. To leverage these for improved robot learning, we propose $\textbf{POCR}$, a new framework for building pre-trained object-centric representations for robotic control. Building on theories of "what-where" representations in psychology and computer vision, we use segmentations from a pre-trained model to stably locate across timesteps, various entities in the scene, capturing "where" information. To each such segmented entity, we apply other pre-trained models that build vector descriptions suitable for robotic control tasks, thus capturing "what" the entity is. Thus, our pre-trained object-centric representations for control are constructed by appropriately combining the outputs of off-the-shelf pre-trained models, with no new training. On various simulated and real robotic tasks, we show that imitation policies for robotic manipulators trained on POCR achieve better performance and systematic generalization than state of the art pre-trained representations for robotics, as well as prior object-centric representations that are typically trained from scratch.


title: PristiQ: A Co-Design Framework for Preserving Data Security of Quantum Learning in the Cloud

abstract: Benefiting from cloud computing, today's early-stage quantum computers can be remotely accessed via the cloud services, known as Quantum-as-a-Service (QaaS). However, it poses a high risk of data leakage in quantum machine learning (QML). To run a QML model with QaaS, users need to locally compile their quantum circuits including the subcircuit of data encoding first and then send the compiled circuit to the QaaS provider for execution. If the QaaS provider is untrustworthy, the subcircuit to encode the raw data can be easily stolen. Therefore, we propose a co-design framework for preserving the data security of QML with the QaaS paradigm, namely PristiQ. By introducing an encryption subcircuit with extra secure qubits associated with a user-defined security key, the security of data can be greatly enhanced. And an automatic search algorithm is proposed to optimize the model to maintain its performance on the encrypted quantum data. Experimental results on simulation and the actual IBM quantum computer both prove the ability of PristiQ to provide high security for the quantum data while maintaining the model performance in QML.


title: A Framework for Feasible Counterfactual Exploration incorporating Causality, Sparsity and Density

abstract: The imminent need to interpret the output of a Machine Learning model with counterfactual (CF) explanations - via small perturbations to the input - has been notable in the research community. Although the variety of CF examples is important, the aspect of them being feasible at the same time, does not necessarily apply in their entirety. This work uses different benchmark datasets to examine through the preservation of the logical causal relations of their attributes, whether CF examples can be generated after a small amount of changes to the original input, be feasible and actually useful to the end-user in a real-world case. To achieve this, we used a black box model as a classifier, to distinguish the desired from the input class and a Variational Autoencoder (VAE) to generate feasible CF examples. As an extension, we also extracted two-dimensional manifolds (one for each dataset) that located the majority of the feasible examples, a representation that adequately distinguished them from infeasible ones. For our experimentation we used three commonly used datasets and we managed to generate feasible and at the same time sparse, CF examples that satisfy all possible predefined causal constraints, by confirming their importance with the attributes in a dataset.


title: Leveraging Adversarial Detection to Enable Scalable and Low Overhead RowHammer Mitigations

abstract: RowHammer is a prime example of read disturbance in DRAM where repeatedly accessing (hammering) a row of DRAM cells (DRAM row) induces bitflips in other physically nearby DRAM rows. RowHammer solutions perform preventive actions (e.g., refresh neighbor rows of the hammered row) that mitigate such bitflips to preserve memory isolation, a fundamental building block of security and privacy in modern computing systems. However, preventive actions induce non-negligible memory request latency and system performance overheads as they interfere with memory requests in the memory controller. As shrinking technology node size over DRAM chip generations exacerbates RowHammer, the overheads of RowHammer solutions become prohibitively large. As a result, a malicious program can effectively hog the memory system and deny service to benign applications by causing many RowHammer preventive actions. In this work, we tackle the performance overheads of RowHammer solutions by tracking the generators of memory accesses that trigger RowHammer solutions. To this end, we propose BreakHammer. BreakHammer cooperates with existing RowHammer solutions to identify hardware threads that trigger preventive actions. To do so, BreakHammer estimates the RowHammer likelihood of a thread, based on how frequently it triggers RowHammer preventive actions. BreakHammer limits the number of on-the-fly requests a thread can inject into the memory system based on the thread's RowHammer likelihood. By doing so, BreakHammer significantly reduces the number of performed counter-measures, improves the system performance by an average (maximum) of 48.7% (105.5%), and reduces the maximum slowdown induced on a benign application by 14.6% with near-zero area overhead (e.g., 0.0002% of a highend processor's chip area).


title: Deep SE(3)-Equivariant Geometric Reasoning for Precise Placement Tasks

abstract: Many robot manipulation tasks can be framed as geometric reasoning tasks, where an agent must be able to precisely manipulate an object into a position that satisfies the task from a set of initial conditions. Often, task success is defined based on the relationship between two objects - for instance, hanging a mug on a rack. In such cases, the solution should be equivariant to the initial position of the objects as well as the agent, and invariant to the pose of the camera. This poses a challenge for learning systems which attempt to solve this task by learning directly from high-dimensional demonstrations: the agent must learn to be both equivariant as well as precise, which can be challenging without any inductive biases about the problem. In this work, we propose a method for precise relative pose prediction which is provably SE(3)-equivariant, can be learned from only a few demonstrations, and can generalize across variations in a class of objects. We accomplish this by factoring the problem into learning an SE(3) invariant task-specific representation of the scene and then interpreting this representation with novel geometric reasoning layers which are provably SE(3) equivariant. We demonstrate that our method can yield substantially more precise placement predictions in simulated placement tasks than previous methods trained with the same amount of data, and can accurately represent relative placement relationships data collected from real-world demonstrations. Supplementary information and videos can be found at https://sites.google.com/view/reldist-iclr-2023.


title: Pion mass dependence in $D\pi$ scattering and the $D_0^*(2300)$ resonance from lattice QCD

abstract: Lattice QCD results for isospin $I=\frac{1}{2}$ $D\pi$ scattering are presented. Utilizing a series of $N_{\text{f}}=2+1$ Wilson-Clover ensembles with pion masses of $m_\pi \approx 132, 208, 305$ and $317$ MeV, various two-particle operators are constructed and the corresponding finite-volume spectra are determined. The $S$ and $P$-wave scattering phase shifts are then extracted using the L\"{u}scher approach. A clear trend for the motion of the $D_0^*(2300)$ pole is identified. With the physical pion mass configurations also included, this calculation constitutes the first lattice calculation in which the pion mass dependence of the $D_0^*(2300)$ pole is investigated and the scattering lengths are extrapolated/interpolated to the physical pion mass in $D\pi$ scattering.


title: Conditional algebras

abstract: Drawing on the classic paper by Chellas "Basic conditional logic" (1975), we propose a general algebraic framework for studying a binary operation of conditional that models universal features of the "if..., then..." connective as strictly related to the unary modal necessity operator. To this end, we introduce a variety of conditional algebras, and we develop its duality and canonical extensions theory.


title: Holomorphic Witten instanton complexes on stratified pseudomanifolds with K\"ahler wedge metrics

abstract: We construct Witten instanton complexes for K\"ahler Hamiltonian Morse functions on stratified pseudomanifolds with wedge K\"ahler metrics satisfying a local conformally totally geodesic condition. We use this to extend Witten's holomorphic Morse inequalities for the $L^2$ cohomology of Dolbeault complexes, deriving versions for Poincar\'e Hodge polynomials, the spin Dirac and signature complexes for which we prove rigidity results, in particular establishing the rigidity of $L^2$ de Rham cohomology for these circle actions. We generalize formulas studied by Witten and Gibbons-Hawking for the equivariant signature and extend formulas used to compute NUT charges of gravitational instantons. We discuss conjectural inequalities extending known Lefschetz-Riemann-Roch formulas for other cohomology theories including those of Baum-Fulton-Quart. As far as the author is aware this article contains the first extension of Witten's holomorphic Morse inequalities to singular spaces, and the first results on rigidity of $L^2$ de Rham and Dolbeault cohomology for the actions studied on stratified pseudomanifolds


title: A Nonnegative Weak Solution to the Phase Field Crystal Model with Degenerate Mobility

abstract: Phase field crystal is a model used to describe the behavior of crystalline materials at the mesoscale. In this study, we investigate the well-posedness of a phase field crystal equation subject to a degenerate mobility $M(u)$ that equals zero for $u\leq 0$. First, we prove the existence of a weak solution to a phase field crystal equation with non-degenerate cutoff mobility. Then, assuming that the initial data $u_0(x)$ is positive, we establish the existence of a nonnegative weak solution to the degenerate case. Such solution is the limit of solutions corresponding to non-degenerate mobilities. We also verify that such a weak solution satisfies an energy dissipation inequality.


title: Modified Bergman spaces on the unit ball of $\mathbb C^n$ and applications

abstract: In this paper, we introduce new spaces of holomorphic functions on the unit ball $\mathbb{B}_{n}$ of $\mathbb{C}^{n}$ generalizing the classical Bergman spaces. The main results include the properties of some operators and integrals representations such as Bergman-type projections, and Berezin transform.


title: Joint Quality Assessment and Example-Guided Image Processing by Disentangling Picture Appearance from Content

abstract: The deep learning revolution has strongly impacted low-level image processing tasks such as style/domain transfer, enhancement/restoration, and visual quality assessments. Despite often being treated separately, the aforementioned tasks share a common theme of understanding, editing, or enhancing the appearance of input images without modifying the underlying content. We leverage this observation to develop a novel disentangled representation learning method that decomposes inputs into content and appearance features. The model is trained in a self-supervised manner and we use the learned features to develop a new quality prediction model named DisQUE. We demonstrate through extensive evaluations that DisQUE achieves state-of-the-art accuracy across quality prediction tasks and distortion types. Moreover, we demonstrate that the same features may also be used for image processing tasks such as HDR tone mapping, where the desired output characteristics may be tuned using example input-output pairs.


title: Topological Equatorial Waves and Violation (or not) of the Bulk Edge Correspondence

abstract: Atmospheric and oceanic mass transport near the equator display a well-studied asymmetry characterized by two modes moving eastward. This asymmetric edge transport is characteristic of interfaces separating two-dimensional topological insulators. The northern and southern hemispheres are insulating because of the presence of a Coriolis force parameter that vanishes only in the vicinity of the equator. A central tenet of topological insulators, the bulk edge correspondence, relates the quantized edge asymmetry to bulk properties of the insulating phases, which makes it independent of the Coriolis force profile near the equator. We show that for a natural differential Hamiltonian model of the atmospheric and oceanic transport, the bulk-edge correspondence does not always apply. In fact, an arbitrary quantized asymmetry can be obtained for specific, discontinuous, such profiles. The results are based on a careful analysis of the spectral flow of the branches of absolutely continuous spectrum of a shallow-water Hamiltonian. Numerical simulations validate our theoretical findings.


title: An Optimal MPC Algorithm for Subunit-Monge Matrix Multiplication, with Applications to LIS

abstract: We present an $O(1)$-round fully-scalable deterministic massively parallel algorithm for computing the min-plus matrix multiplication of unit-Monge matrices. We use this to derive a $O(\log n)$-round fully-scalable massively parallel algorithm for solving the exact longest increasing subsequence (LIS) problem. For a fully-scalable MPC regime, this result substantially improves the previously known algorithm of $O(\log^4 n)$-round complexity, and matches the best algorithm for computing the $(1+\epsilon)$-approximation of LIS.


title: Generating Synthetic Rainfall Fields by R-vine Copulas Applied to Seamless Probabilistic Predictions

abstract: Many post-processing methods improve forecasts at individual locations but remove their correlation structure, which is crucial for predicting larger-scale events like total precipitation amount over areas such as river catchments that are relevant for weather warnings and flood predictions. We propose a method to reintroduce spatial correlation into a post-processed forecast using an R-vine copula fitted to historical observations. This method works similarly to related approaches like the Schaake shuffle and ensemble copula coupling, i.e., by rearranging predictions at individual locations and reintroducing spatial correlation while maintaining the post-processed marginal distribution. Here, the copula measures how well an arrangement compares with the historical distribution of precipitation. No close relationship is needed between the post-processed marginal distributions and the spatial correlation source. This is an advantage compared to Schaake shuffle and ensemble copula coupling, which rely on a ranking with no ties at each considered location in their source for spatial correlations. However, weather variables such as the precipitation amount, whose distribution has an atom at zero, have rankings with ties. To evaluate the proposed method, it is applied to a precipitation forecast produced by a combination model with two input forecasts that deliver calibrated marginal distributions but without spatial correlations. The obtained results indicate that the calibration of the combination model carries over to the output of the proposed model, i.e., the evaluation of area predictions shows a similar improvement in forecast quality as the predictions for individual locations. Additionally, the spatial correlation of the forecast is evaluated with the help of object-based metrics, for which the proposed model also shows an improvement compared to both input forecasts.


title: An FPTAS for Shortest-Longest Path Problem

abstract: Motivated by multi-domain Service Function Chain (SFC) orchestration, we define the Shortest-Longest Path (SLP) problem, prove its hardness, and design an efficient Fully Polynomial Time Approximation Scheme (FPTAS) using the scaling and rounding technique to compute an approximation solution with provable performance guarantee. The SLP problem and its solution algorithm have theoretical significance in multicriteria optimization and also have application potential in QoS routing and multi-domain network resource allocation scenarios.


title: SCHENO: Measuring Schema vs. Noise in Graphs

abstract: Real-world data is typically a noisy manifestation of a core pattern (schema), and the purpose of data mining algorithms is to uncover that pattern, thereby splitting (i.e. decomposing) the data into schema and noise. We introduce SCHENO, a principled evaluation metric for the goodness of a schema-noise decomposition of a graph. SCHENO captures how schematic the schema is, how noisy the noise is, and how well the combination of the two represent the original graph data. We visually demonstrate what this metric prioritizes in small graphs, then show that if SCHENO is used as the fitness function for a simple optimization strategy, we can uncover a wide variety of patterns. Finally, we evaluate several well-known graph mining algorithms with this metric; we find that although they produce patterns, those patterns are not always the best representation of the input data.


title: How often can two independent elephant random walks on $\mathbb{Z}$ meet?

abstract: We show that two independent elephant random walks on the integer lattice $\mathbb{Z}$ meet each other finitely often or infinitely often depends on whether the memory parameter $p$ is strictly larger than $3/4$ or not. Asymptotic results for the distance between them are also obtained.


title: Accelerating the Generation of Molecular Conformations with Progressive Distillation of Equivariant Latent Diffusion Models

abstract: Recent advances in fast sampling methods for diffusion models have demonstrated significant potential to accelerate generation on image modalities. We apply these methods to 3-dimensional molecular conformations by building on the recently introduced GeoLDM equivariant latent diffusion model (Xu et al., 2023). We evaluate trade-offs between speed gains and quality loss, as measured by molecular conformation structural stability. We introduce Equivariant Latent Progressive Distillation, a fast sampling algorithm that preserves geometric equivariance and accelerates generation from latent diffusion models. Our experiments demonstrate up to 7.5x gains in sampling speed with limited degradation in molecular stability. These results suggest this accelerated sampling method has strong potential for high-throughput in silico molecular conformations screening in computational biochemistry, drug discovery, and life sciences applications.


title: Discrete non-commutative hungry Toda lattice and its application in matrix computation

abstract: In this paper, we plan to show an eigenvalue algorithm for block Hessenberg matrices by using the idea of non-commutative integrable systems and matrix-valued orthogonal polynomials. We introduce adjacent families of matrix-valued $\theta$-deformed bi-orthogonal polynomials, and derive corresponding discrete non-commutative hungry Toda lattice from discrete spectral transformations for polynomials. It is shown that this discrete system can be used as a pre-precessing algorithm for block Hessenberg matrices. Besides, some convergence analysis and numerical examples of this algorithm are presented.


title: Authentic Emotion Mapping: Benchmarking Facial Expressions in Real News

abstract: In this paper, we present a novel benchmark for Emotion Recognition using facial landmarks extracted from realistic news videos. Traditional methods relying on RGB images are resource-intensive, whereas our approach with Facial Landmark Emotion Recognition (FLER) offers a simplified yet effective alternative. By leveraging Graph Neural Networks (GNNs) to analyze the geometric and spatial relationships of facial landmarks, our method enhances the understanding and accuracy of emotion recognition. We discuss the advancements and challenges in deep learning techniques for emotion recognition, particularly focusing on Graph Neural Networks (GNNs) and Transformers. Our experimental results demonstrate the viability and potential of our dataset as a benchmark, setting a new direction for future research in emotion recognition technologies. The codes and models are at: https://github.com/wangzhifengharrison/benchmark_real_news


title: Performance Analysis of RIS-Assisted Spectrum Sharing Systems

abstract: We propose a reconfigurable intelligent surface (RIS)-assisted underlay spectrum sharing system, in which a RIS-assisted secondary network shares the spectrum licensed for a primary network. The secondary network consists of a secondary source (SS), an RIS, and a secondary destination (SD), operating in a Rician fading environment. We study the performance of the secondary network while considering a peak power constraint at the SS and an interference power constraint at the primary receiver (PR). Initially, we characterize the statistics of the signal-to-noise ratio (SNR) of the RIS-assisted secondary network by deriving novel analytical expressions for the cumulative distribution function (CDF) and probability density function (PDF) in terms of the incomplete H-function. Building upon the SNR statistics, we analyze the outage probability, ergodic capacity, and average bit error rate, subsequently deriving novel exact expressions for these performance measures. Furthermore, we obtain novel asymptotic expressions for the performance measures of interest when the peak power of the SS is high. Finally, we conduct exhaustive Monte-Carlo simulations to confirm the correctness of our theoretical analysis.


title: Global Bifurcation of Non-Radial Solutions for Symmetric Sub-linear Elliptic Systems on the Planar Unit Disc

abstract: In this paper, we prove a global bifurcation result for the existence of non-radial branches of solutions to the paramterized family of $\Gamma$-symmetric problems $-\Delta u=f(\alpha,z,u)$, $u|_{\partial D}=0$ on the unit disc $D:=\{z\in \mathbb{C} : |z|<1\}$ with $u(z)\in \mathbb{R}^k$, where $\mathbb{R}^k$ is an orthogonal $\Gamma$-representation, $f: \mathbb{R} \times \overline{D} \times \mathbb{R}^k\to \mathbb{R}^k$ is a sub-linear $\Gamma$-equivariant continuous function, differentiable with respect to $u$ at zero and satisfying the conditions $f(\alpha, e^{i\theta}z,u)=f(\alpha, z,u)$ for all $\theta\in \mathbb{R}$ and $f(z,-u)=-f(z,u)$.


title: ODE-DPS: ODE-based Diffusion Posterior Sampling for Inverse Problems in Partial Differential Equation

abstract: In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired data or necessitate retraining neural networks for modifications in the conditions of the inverse problem, significantly reducing the efficiency of inversion and limiting its applicability. To overcome this challenge, in this paper, leveraging the score-based generative diffusion model, we introduce a novel unsupervised inversion methodology tailored for solving inverse problems arising from PDEs. Our approach operates within the Bayesian inversion framework, treating the task of solving the posterior distribution as a conditional generation process achieved through solving a reverse-time stochastic differential equation. Furthermore, to enhance the accuracy of inversion results, we propose an ODE-based Diffusion Posterior Sampling inversion algorithm. The algorithm stems from the marginal probability density functions of two distinct forward generation processes that satisfy the same Fokker-Planck equation. Through a series of experiments involving various PDEs, we showcase the efficiency and robustness of our proposed method.


title: Histropy: A Computer Program for Quantifications of Histograms of 2D Gray-scale Images

abstract: The computer program "Histropy" is an interactive Python program for the quantification of selected features of two-dimensional (2D) images/patterns (in either JPG/JPEG, PNG, GIF, BMP, or baseline TIF/TIFF formats) using calculations based on the pixel intensities in this data, their histograms, and user-selected sections of those histograms. The histograms of these images display pixel-intensity values along the x-axis (of a 2D Cartesian plot), with the frequency of each intensity value within the image represented along the y-axis. The images need to be of 8-bit or 16-bit information depth and can be of arbitrary size. Histropy generates an image's histogram surrounded by a graphical user interface that allows one to select any range of image-pixel intensity levels, i.e. sections along the histograms' x-axis, using either the computer mouse or numerical text entries. The program subsequently calculates the (so-called Monkey Model) Shannon entropy and root-mean-square contrast for the selected section and displays them as part of what we call a "histogram-workspace-plot." To support the visual identification of small peaks in the histograms, the user can switch between a linear and log-base-10 display scale for the y-axis of the histograms. Pixel intensity data from different images can be overlaid onto the same histogram-workspace-plot for visual comparisons. The visual outputs of the program can be saved as histogram-workspace-plots in the PNG format for future usage. The source code of the program and a brief user manual are published in the supporting materials as well as on GitHub. Instead of taking only 2D images as inputs, the program's functionality could be extended by a few lines of code to other potential uses employing data tables with one or two dimensions in the CSV format.


title: Galactic Superbubbles in 3D: Wind Formation and Cloud Shielding

abstract: Galactic superbubbles are triggered by stellar feedback in the discs of star-forming galaxies. They are important in launching galactic winds, which play a key role in regulating the mass and energy exchange in galaxies. Observations can only reveal projected information and the 3D structure of such winds is quite complex. Therefore, numerical simulations are required to further our understanding of such structures. Here, we describe hydrodynamical simulations targeting two spatial scales. Large-scale superbubble models reveal supernova-driven outflows, and their subsequent merging, which leads to galactic wind formation. Additionally, the turbulence parameter $\sigma_t$ not only affects disc formation, but also influences mass and energy characteristics, controlling gas distribution and the injection rate in the simulated star formation zone. Small-scale wind-multicloud models indicate that isolated clouds are susceptible to instabilities, leading to fragmentation and dense gas destruction. In contrast, in closer cloud configurations, the condensation mechanism becomes important owing to hydrodynamic shielding, which helps to maintain the cold material throughout the evolution of the system. These simulations provide a comprehensive picture of galactic winds, showing how large-scale superbubble dynamics create the environment where small-scale wind-multicloud interactions shape the interstellar and circumgalactic media, ultimately regulating galaxy evolution.


title: Unified Map Handling for Robotic Systems: Enhancing Interoperability and Efficiency Across Diverse Environments

abstract: Mapping is a time-consuming process for deploying robotic systems to new environments. The handling of maps is also risk-adverse when not managed effectively. We propose here, a standardised approach to handling such maps in a manner which focuses on the information contained wherein such as global location, object positions, topology, and occupancy. As part of this approach, associated management scripts are able to assist with generation of maps both through direct and indirect information restructuring, and with template and procedural generation of missing data. These approaches are able to, when combined, improve the handling of maps to enable more efficient deployments and higher interoperability between platforms. Alongside this, a collection of sample datasets of fully-mapped environments are included covering areas such as agriculture, urban roadways, and indoor environments.


title: Generalized Regression with Conditional GANs

abstract: Regression is typically treated as a curve-fitting process where the goal is to fit a prediction function to data. With the help of conditional generative adversarial networks, we propose to solve this age-old problem in a different way; we aim to learn a prediction function whose outputs, when paired with the corresponding inputs, are indistinguishable from feature-label pairs in the training dataset. We show that this approach to regression makes fewer assumptions on the distribution of the data we are fitting to and, therefore, has better representation capabilities. We draw parallels with generalized linear models in statistics and show how our proposal serves as an extension of them to neural networks. We demonstrate the superiority of this new approach to standard regression with experiments on multiple synthetic and publicly available real-world datasets, finding encouraging results, especially with real-world heavy-tailed regression datasets. To make our work more reproducible, we release our source code. Link to repository: https://anonymous.4open.science/r/regressGAN-7B71/


title: A Survey on the Memory Mechanism of Large Language Model based Agents

abstract: Large language model (LLM) based agents have recently attracted much attention from the research and industry communities. Compared with original LLMs, LLM-based agents are featured in their self-evolving capability, which is the basis for solving real-world problems that need long-term and complex agent-environment interactions. The key component to support agent-environment interactions is the memory of the agents. While previous studies have proposed many promising memory mechanisms, they are scattered in different papers, and there lacks a systematical review to summarize and compare these works from a holistic perspective, failing to abstract common and effective designing patterns for inspiring future studies. To bridge this gap, in this paper, we propose a comprehensive survey on the memory mechanism of LLM-based agents. In specific, we first discuss ''what is'' and ''why do we need'' the memory in LLM-based agents. Then, we systematically review previous studies on how to design and evaluate the memory module. In addition, we also present many agent applications, where the memory module plays an important role. At last, we analyze the limitations of existing work and show important future directions. To keep up with the latest advances in this field, we create a repository at \url{https://github.com/nuster1128/LLM_Agent_Memory_Survey}.


title: Optimal Non-Adaptive Tolerant Junta Testing via Local Estimators

abstract: We give a non-adaptive algorithm that makes $2^{\tilde{O}(\sqrt{k\log(1/\varepsilon_2 - \varepsilon_1)})}$ queries to a Boolean function $f:\{\pm 1\}^n \rightarrow \{\pm 1\}$ and distinguishes between $f$ being $\varepsilon_1$-close to some $k$-junta versus $\varepsilon_2$-far from every $k$-junta. At the heart of our algorithm is a local mean estimation procedure for Boolean functions that may be of independent interest. We complement our upper bound with a matching lower bound, improving a recent lower bound obtained by Chen et al. We thus obtain the first tight bounds for a natural property of Boolean functions in the tolerant testing model.


title: Predict to Minimize Swap Regret for All Payoff-Bounded Tasks

abstract: A sequence of predictions is calibrated if and only if it induces no swap regret to all down-stream decision tasks. We study the Maximum Swap Regret (MSR) of predictions for binary events: the swap regret maximized over all downstream tasks with bounded payoffs. Previously, the best online prediction algorithm for minimizing MSR is obtained by minimizing the K1 calibration error, which upper bounds MSR up to a constant factor. However, recent work (Qiao and Valiant, 2021) gives an ${\Omega}(T^{0.528})$ lower bound for the worst-case expected $K_1$ calibration error incurred by any randomized algorithm in T rounds, presenting a barrier to achieving better rates for MSR. Several relaxations of MSR have been considered to overcome this barrier, via external regret (Kleinberg et al., 2023) and regret bounds depending polynomially on the number of actions in downstream tasks (Noarov et al., 2023; Roth and Shi, 2024). We show that the barrier can be surpassed without any relaxations: we give an efficient randomized prediction algorithm that guarantees $O(\sqrt{T}logT)$ expected MSR. We also discuss the economic utility of calibration by viewing MSR as a decision-theoretic calibration error metric and study its relationship to existing metrics.


title: IMO: Greedy Layer-Wise Sparse Representation Learning for Out-of-Distribution Text Classification with Pre-trained Models

abstract: Machine learning models have made incredible progress, but they still struggle when applied to examples from unseen domains. This study focuses on a specific problem of domain generalization, where a model is trained on one source domain and tested on multiple target domains that are unseen during training. We propose IMO: Invariant features Masks for Out-of-Distribution text classification, to achieve OOD generalization by learning invariant features. During training, IMO would learn sparse mask layers to remove irrelevant features for prediction, where the remaining features keep invariant. Additionally, IMO has an attention module at the token level to focus on tokens that are useful for prediction. Our comprehensive experiments show that IMO substantially outperforms strong baselines in terms of various evaluation metrics and settings.


title: Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object Segmentation

abstract: Conventional video object segmentation (VOS) methods usually necessitate a substantial volume of pixel-level annotated video data for fully supervised learning. In this paper, we present HVC, a \textbf{h}ybrid static-dynamic \textbf{v}isual \textbf{c}orrespondence framework for self-supervised VOS. HVC extracts pseudo-dynamic signals from static images, enabling an efficient and scalable VOS model. Our approach utilizes a minimalist fully-convolutional architecture to capture static-dynamic visual correspondence in image-cropped views. To achieve this objective, we present a unified self-supervised approach to learn visual representations of static-dynamic feature similarity. Firstly, we establish static correspondence by utilizing a priori coordinate information between cropped views to guide the formation of consistent static feature representations. Subsequently, we devise a concise convolutional layer to capture the forward / backward pseudo-dynamic signals between two views, serving as cues for dynamic representations. Finally, we propose a hybrid visual correspondence loss to learn joint static and dynamic consistency representations. Our approach, without bells and whistles, necessitates only one training session using static image data, significantly reducing memory consumption ($\sim$16GB) and training time ($\sim$\textbf{2h}). Moreover, HVC achieves state-of-the-art performance in several self-supervised VOS benchmarks and additional video label propagation tasks.


title: Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications

abstract: The rise of deep learning has marked significant progress in fields such as computer vision, natural language processing, and medical imaging, primarily through the adaptation of pre-trained models for specific tasks. Traditional fine-tuning methods, involving adjustments to all parameters, face challenges due to high computational and memory demands. This has led to the development of Parameter Efficient Fine-Tuning (PEFT) techniques, which selectively update parameters to balance computational efficiency with performance. This review examines PEFT approaches, offering a detailed comparison of various strategies highlighting applications across different domains, including text generation, medical imaging, protein modeling, and speech synthesis. By assessing the effectiveness of PEFT methods in reducing computational load, speeding up training, and lowering memory usage, this paper contributes to making deep learning more accessible and adaptable, facilitating its wider application and encouraging innovation in model optimization. Ultimately, the paper aims to contribute towards insights into PEFT's evolving landscape, guiding researchers and practitioners in overcoming the limitations of conventional fine-tuning approaches.


title: Uncovering Obscured Phonon Dynamics from Powder Inelastic Neutron Scattering using Machine Learning

abstract: The study of phonon dynamics is pivotal for understanding material properties, yet it faces challenges due to the irreversible information loss inherent in powder inelastic neutron scattering spectra and the limitations of traditional analysis methods. In this study, we present a machine learning framework designed to reveal obscured phonon dynamics from powder spectra. Using a variational autoencoder, we obtain a disentangled latent representation of spectra and successfully extract force constants for reconstructing phonon dispersions. Notably, our model demonstrates effective applicability to experimental data even when trained exclusively on physics-based simulations. The fine-tuning with experimental spectra further mitigates issues arising from domain shift. Analysis of latent space underscores the model's versatility and generalizability, affirming its suitability for complex system applications. Furthermore, our framework's two-stage design is promising for developing a universal pre-trained feature extractor. This approach has the potential to revolutionize neutron measurements of phonon dynamics, offering researchers a potent tool to decipher intricate spectra and gain valuable insights into the intrinsic physics of materials.

categories: cond-mat.mtrl-sci cond-mat.dis-nn physics.comp-ph physics.data-an


title: Gluing diffeomorphisms, bi-Lipschitz mappings and homeomorphisms

abstract: In the paper, we address the following problem, often encountered in geometric constructions: having defined an orientation preserving diffeomorphism in a number of `patches' on a manifold $\mathcal{M}$, can we extend it to a diffeomorphism of the whole manifold $\mathcal{M}$? We give a positive answer, provided the `patches' are sufficiently regular. Then, we extend the same result to the case of bi-Lipschitz homeomorphisms and homeomorphisms.


title: MFHCA: Enhancing Speech Emotion Recognition Via Multi-Spatial Fusion and Hierarchical Cooperative Attention

abstract: Speech emotion recognition is crucial in human-computer interaction, but extracting and using emotional cues from audio poses challenges. This paper introduces MFHCA, a novel method for Speech Emotion Recognition using Multi-Spatial Fusion and Hierarchical Cooperative Attention on spectrograms and raw audio. We employ the Multi-Spatial Fusion module (MF) to efficiently identify emotion-related spectrogram regions and integrate Hubert features for higher-level acoustic information. Our approach also includes a Hierarchical Cooperative Attention module (HCA) to merge features from various auditory levels. We evaluate our method on the IEMOCAP dataset and achieve 2.6\% and 1.87\% improvements on the weighted accuracy and unweighted accuracy, respectively. Extensive experiments demonstrate the effectiveness of the proposed method.


title: Characterization of order structures avoiding three-term arithmetic progressions

abstract: It is known that the set of all nonnegative integers may be equipped with a total order that is chaotic in the sense that there is no monotone three-term arithmetic progressions. Such chaotic order must be so complicated that the resulting ordered set cannot be order isomorphic to the set of all nonnegative integers or the set of all integers with the standard order. In this paper, we completely characterize order structures of chaotic orders on the set of all nonnegative integers, as well as on the set of all integers and on the set of all rational numbers.


title: Eclectic Notes on Uncertainty, Information, and Classical Dynamics

abstract: Information is everywhere in nature which is very uncertain and unpredictable. But information, in itself, is a very ambiguous term. In this cursory write-up, we attempt to understand the formal meaning of information by quantifying uncertainty and discuss how it naturally appears in two core topics of classical physics -- classical mechanics and statistical mechanics. In the process, we witness how the concepts of the information theory render a unique viewpoint in physics. Except for the presentation of the material, the author claims no originality; however, the responsibility of every inadvertent error lies entirely with the author.


title: Planning of Truck Platooning for Road-Network Capacitated Vehicle Routing Problem

abstract: Truck platooning, a linking technology of trucks on the highway, has gained enormous attention in recent years due to its benefits in energy and operation cost savings. However, most existing studies on truck platooning limit their focus on scenarios in which each truck can serve only one customer demand and is thus with a specified origin-destination pair, so only routing and time schedules are considered. Nevertheless, in real-world logistics, each truck may need to serve multiple customers located at different places, and the operator has to determine not only the routing and time schedules of each truck but also the set of customers allocated to each truck and their sequence to visit. This is well known as a capacitated vehicle routing problem with time windows (CVRPTW), and considering the application of truck platooning in such a problem entails new modeling frameworks and tailored solution algorithms. In light of this, this study makes the first attempt to optimize the truck platooning plan for a road-network CVRPTW to minimize the total operation cost, including vehicles' fixed dispatch cost and energy cost, while fulfilling all delivery demands within their time window constraints. Specifically, the operation plan will dictate the number of trucks to be dispatched, the set of customers, and the routing and time schedules for each truck. In addition, the modeling framework is constructed based on a road network instead of a traditional customer node graph to better resemble and facilitate the platooning operation. A 3-stage algorithm embedded with a "route-then-schedule" scheme, dynamic programming, and modified insertion heuristic, is developed to solve the proposed model in a timely manner. Numerical experiments are conducted to validate the modeling framework, demonstrate the performance of the proposed solution algorithm, and quantify the benefit of truck platooning.


title: Ferroelectricity in an Antiferromagnetic Vanadium Trichloride Monolayer

abstract: Multiferroicity allows magnetism to be controlled using electric fields or vice versa, which has gained tremendous interest in both fundamental research and device applications. A reduced dimensionality of multiferroic materials is highly desired for device miniaturization, but the coexistence of ferroelectricity and magnetism at the two-dimensional limit is still debated. Here, we used a NbSe2 substrate to break both the C3 rotational and inversion symmetries in monolayer VCl3 and thus introduced exceptional in-plane ferroelectricity into a two-dimensional magnet. Scanning tunnelling spectroscopy directly visualized ferroelectric domains and manipulated their domain boundaries in monolayer VCl3, where coexisting antiferromagnetic order with canted magnetic moments was verified by vibrating sample magnetometer measurements. Our density functional theory calculations highlight the crucial role that highly directional interfacial Cl-Se interactions play in breaking the symmetries and thus in introducing in-plane ferroelectricity, which was further verified by examining an ML-VCl3/graphene sample. Our work demonstrates an approach to manipulate the ferroelectric states in monolayered magnets through van der Waals interfacial interactions.


title: A new iterative algorithm for comprehensive Grobner systems

abstract: A Comprehensive Grobner system for a parametric ideal I in K(A)[X] represents the collection of all Grobner bases of the ideals I' in K[X] obtained as the values of the parameters A vary in K. The recent algorithms for computing them comprehensive Grobner systems consider the corresponding ideal J in K[A,X], and are based on stability of Grobner bases of ideals under specializations of the parameters. Starting from a Grobner basis of J, the computation splits recursively depending on the vanishing of the evaluation of some ``coefficients'' in K[A]. In this paper, taking inspiration from the algorithm described by Nabeshima, we create a new iterative algorithm to compute comprehensive Grobner systems. We show how we keep track of the sub-cases to be considered, and how we avoid some redundant computation branches using ``comparatively-cheap'' ideal-membership tests, instead of radical-membership tests.


title: FedTrans: Efficient Federated Learning via Multi-Model Transformation

abstract: Federated learning (FL) aims to train machine learning (ML) models across potentially millions of edge client devices. Yet, training and customizing models for FL clients is notoriously challenging due to the heterogeneity of client data, device capabilities, and the massive scale of clients, making individualized model exploration prohibitively expensive. State-of-the-art FL solutions personalize a globally trained model or concurrently train multiple models, but they often incur suboptimal model accuracy and huge training costs. In this paper, we introduce FedTrans, a multi-model FL training framework that automatically produces and trains high-accuracy, hardware-compatible models for individual clients at scale. FedTrans begins with a basic global model, identifies accuracy bottlenecks in model architectures during training, and then employs model transformation to derive new models for heterogeneous clients on the fly. It judiciously assigns models to individual clients while performing soft aggregation on multi-model updates to minimize total training costs. Our evaluations using realistic settings show that FedTrans improves individual client model accuracy by 14% - 72% while slashing training costs by 1.6X - 20X over state-of-the-art solutions.


title: Neutron electric dipole moment from isovector quark chromo-electric dipole moment

abstract: We present results from our lattice QCD study of the contribution of the isovector quark cEDM (qcEDM) operator to the neutron EDM. The calculation was carried out on four 2+1+1-flavor highly improved staggered quark ensembles (provided to us by the MILC collaboration) using Wilson-clover quarks to construct correlation functions. We use the nonsinglet axial Ward identity including corrections up to O(a) to show how to control the power-divergent mixing of the isovector qcEDM operator with the lower dimensional pseudoscalar operator. Results for the nEDM are presented after conversion to the MS scheme at the leading-log order.


title: Chern-Simmons electrodynamics and torsion dark matter axions

abstract: In this paper, we delve into the influence of torsion axial pseudo vector on dark photons in an axion torsionic background, as investigated previously by Duncan et al[ Nucl Phys B 387:215 (1992)]. Notably, axial torsion, owing to its significantly greater mass compared to axions, gives rise to magnetic helicity in torsionful Chern-Simons (CS) electrodynamics, leading to the damping of magnetic fields. In QCD scale the damping from dark massive photons leads us to obtain a magnetic field of $10^{-8}$ Gauss, which is approximated the order of magnitude of magnetic fields at present universe. This result is obtained by considering that torsion has the value of the 1 MeV at the early universe, and can be improved to the higher value of $10^{-3}$ Gauss when the axial torsion 0-component is given by $10^{8}$ MeV and the mass of dark photon is approximated equal to the axion. The axion plays a crucial role in achieving CS dynamo action arising from axions. This study is useful in deepening our understanding of fundamental physics, from nuclear interactions to the nature of dark matter.


title: Reliable Model Watermarking: Defending Against Theft without Compromising on Evasion

abstract: With the rise of Machine Learning as a Service (MLaaS) platforms,safeguarding the intellectual property of deep learning models is becoming paramount. Among various protective measures, trigger set watermarking has emerged as a flexible and effective strategy for preventing unauthorized model distribution. However, this paper identifies an inherent flaw in the current paradigm of trigger set watermarking: evasion adversaries can readily exploit the shortcuts created by models memorizing watermark samples that deviate from the main task distribution, significantly impairing their generalization in adversarial settings. To counteract this, we leverage diffusion models to synthesize unrestricted adversarial examples as trigger sets. By learning the model to accurately recognize them, unique watermark behaviors are promoted through knowledge injection rather than error memorization, thus avoiding exploitable shortcuts. Furthermore, we uncover that the resistance of current trigger set watermarking against removal attacks primarily relies on significantly damaging the decision boundaries during embedding, intertwining unremovability with adverse impacts. By optimizing the knowledge transfer properties of protected models, our approach conveys watermark behaviors to extraction surrogates without aggressively decision boundary perturbation. Experimental results on CIFAR-10/100 and Imagenette datasets demonstrate the effectiveness of our method, showing not only improved robustness against evasion adversaries but also superior resistance to watermark removal attacks compared to state-of-the-art solutions.


title: Switchable quantized signal between longitudinal conductance and Hall conductance in dual quantum spin Hall insulator TaIrTe$_4$

abstract: Topological insulating states in two-dimensional (2D) materials are ideal systems to study different types of quantized response signals due to their in gap metallic states. Very recently, the quantum spin Hall (QSH) effect was discovered in monolayer $\text{TaIrTe}_4$ via the observation of quantized longitudinal conductance that rarely exists in other 2D topological insulators. The non-trivial $Z_2$ topological charges can exist at both charge neutrality point and the van Hove singularity point with correlation effect induced band gap. Based on this model 2D material, we studied the switch of quantized signals between longitudinal conductance and transversal Hall conductance via tuning external magnetic field. In $Z_2$ topological phase of monolayer $\text{TaIrTe}_4$, the zero Chern number can be understood as 1-1=0 from the double band inversion from spin-up and spin-down channels. After applying a magnetic field perpendicular to the plane, the Zeeman split changes the band order for one branch of the band inversion from spin-up and spin-down channels, along with a sign charge of the Berry phase. Then the net Chern number of 1-1=0 is tuned to 1+1=2 or -1-1=-2 depending on the orientation of the magnetic field. The quantized signal not only provides another effective method for the verification of topological state in monolayer $\text{TaIrTe}_4$, but also offers a strategy for the utilization of the new quantum topological states based on switchable quantized responses.


title: An ALMA search for substructure and fragmentation in starless cores in Orion B North

abstract: We present Atacama Large Millimeter/submillimeter Array (ALMA) Cycle 3 observations of 73 starless and protostellar cores in the Orion B North molecular cloud. We detect a total of 34 continuum sources at 106 GHz, and after comparisons with other data, 4 of these sources appear to be starless. Three of the four sources are located near groupings of protostellar sources, while one source is an isolated detection. We use synthetic observations of a simulation modeling a collapsing turbulent, magnetized core to compute the expected number of starless cores that should be detectable with our ALMA observations and find at least two (1.52) starless core should be detectable, consistent with our data. We run a simple virial analysis of the cores to put the Orion B North observations into context with similar previous ALMA surveys of cores in Chamaeleon I and Ophiuchus. We conclude that the Chamaeleon I starless core population is characteristically less bounded than the other two populations, along with external pressure contributions dominating the binding energy of the cores. These differences may explain why the Chamaeleon I cores do not follow turbulent model predictions, while the Ophiuchus and Orion B North cores are consistent with the model.


title: Graph4GUI: Graph Neural Networks for Representing Graphical User Interfaces

abstract: Present-day graphical user interfaces (GUIs) exhibit diverse arrangements of text, graphics, and interactive elements such as buttons and menus, but representations of GUIs have not kept up. They do not encapsulate both semantic and visuo-spatial relationships among elements. To seize machine learning's potential for GUIs more efficiently, Graph4GUI exploits graph neural networks to capture individual elements' properties and their semantic-visuo-spatial constraints in a layout. The learned representation demonstrated its effectiveness in multiple tasks, especially generating designs in a challenging GUI autocompletion task, which involved predicting the positions of remaining unplaced elements in a partially completed GUI. The new model's suggestions showed alignment and visual appeal superior to the baseline method and received higher subjective ratings for preference. Furthermore, we demonstrate the practical benefits and efficiency advantages designers perceive when utilizing our model as an autocompletion plug-in.


title: Error Analysis of Shapley Value-Based Model Explanations: An Informative Perspective

abstract: Shapley value attribution (SVA) is an increasingly popular explainable AI (XAI) method, which quantifies the contribution of each feature to the model's output. However, recent work has shown that most existing methods to implement SVAs have some drawbacks, resulting in biased or unreliable explanations that fail to correctly capture the true intrinsic relationships between features and model outputs. Moreover, the mechanism and consequences of these drawbacks have not been discussed systematically. In this paper, we propose a novel error theoretical analysis framework, in which the explanation errors of SVAs are decomposed into two components: observation bias and structural bias. We further clarify the underlying causes of these two biases and demonstrate that there is a trade-off between them. Based on this error analysis framework, we develop two novel concepts: over-informative and underinformative explanations. We demonstrate how these concepts can be effectively used to understand potential errors of existing SVA methods. In particular, for the widely deployed assumption-based SVAs, we find that they can easily be under-informative due to the distribution drift caused by distributional assumptions. We propose a measurement tool to quantify such a distribution drift. Finally, our experiments illustrate how different existing SVA methods can be over- or under-informative. Our work sheds light on how errors incur in the estimation of SVAs and encourages new less error-prone methods.


title: FSGe: A fast and strongly-coupled 3D fluid-solid-growth interaction method

abstract: Equilibrated fluid-solid-growth (FSGe) is a fast, open source, three-dimensional (3D) computational platform for simulating interactions between instantaneous hemodynamics and long-term vessel wall adaptation through growth and remodeling (G&R). Such models are crucial for capturing adaptations in health and disease and following clinical interventions. In traditional G&R models, this feedback is modeled through highly simplified fluid models, neglecting local variations in blood pressure and wall shear stress (WSS). FSGe overcomes these inherent limitations by strongly coupling the 3D Navier-Stokes equations for blood flow with a 3D equilibrated constrained mixture model (CMMe) for vascular tissue G&R. CMMe allows one to predict long-term evolved mechanobiological equilibria from an original homeostatic state at a computational cost equivalent to that of a standard hyperelastic material model. In illustrative computational examples, we focus on the development of a stable aortic aneurysm in a mouse model to highlight key differences in growth patterns and fluid-solid feedback between FSGe and solid-only G&R models. We show that FSGe is especially important in blood vessels with asymmetric stimuli. Simulation results reveal greater local variation in fluid-derived WSS than in intramural stress (IMS). Thus, differences between FSGe and G&R models became more pronounced with the growing influence of WSS relative to pressure. Future applications in highly localized disease processes, such as for lesion formation in atherosclerosis, can now include spatial and temporal variations of WSS.


title: A congruential recurrence characterizes the inverses of S\'{o}s permutations

abstract: In a proof of the three gaps theorem, a class of permutations known as the S\'{o}s permutations was introduced. It is known that a S\'{o}s permutation, as a sequence, satisfies a certain recurrence (S\'{o}s's recurrence), however, whether the converse holds remains unknown. On the other hand, the inverses of S\'{o}s permutations have been studied also. It has been reported that such a permutation satisfies a congruential recurrence as a sequence. The converse problem of this fact, i.e., whether a permutation satisfying the congruential recurrence is the inverse of a S\'{o}s permutation, is also unsolved, except for a finite number of the degrees of the permutations. This paper relates the set of permutations satisfying the congruential recurrence to other sets of permutations and gives upper bounds for their cardinalities. The upper bounds are in fact tight. In particular, the set of permutations satisfying the congruential recurrence has the same cardinality as that of S\'{o}s permutations, giving the affirmative answer to the above unsolved problem as a corollary. As another corollary, it is shown that all permutation, which is regarded as a congruential quasi-progression of diameter 1 in that the set formed by the first order differences modulo the degree of the permutation is a singleton or a set of two successive integers, is the inverse of a S\'{o}s permutation with an elementary operation called as shift applied. As an application of these facts, we present a procedure that lifts the set of the inverses of the S\'{o}s permutations of a given degree to the set of the same kind with the degree increased by one, without referring to the underlying parameters defining the S\'{o}s permutations or the Farey sequence associated to them.


title: QR Decomposition of Dual Matrices and its Application to Traveling Wave Identification in the Brain

abstract: Matrix decompositions in dual number representations have played an important role in fields such as kinematics and computer graphics in recent years. In this paper, we present a QR decomposition algorithm for dual number matrices, specifically geared towards its application in traveling wave identification, utilizing the concept of proper orthogonal decomposition. When dealing with large-scale problems, we present explicit solutions for the QR, thin QR, and randomized QR decompositions of dual number matrices, along with their respective algorithms with column pivoting. The QR decomposition of dual matrices is an accurate first-order perturbation, with the Q-factor satisfying rigorous perturbation bounds, leading to enhanced orthogonality. In numerical experiments, we discuss the suitability of different QR algorithms when confronted with various large-scale dual matrices, providing their respective domains of applicability. Subsequently, we employed the QR decomposition of dual matrices to compute the DMPGI, thereby attaining results of higher precision. Moreover, we apply the QR decomposition in the context of traveling wave identification, employing the notion of proper orthogonal decomposition to perform a validation analysis of large-scale functional magnetic resonance imaging (fMRI) data for brain functional circuits. Our approach significantly improves the identification of two types of wave signals compared to previous research, providing empirical evidence for cognitive neuroscience theories.


title: Interconversion between block coherence and multipartite entanglement in many-body systems

abstract: Coherence is intrinsically related to projective measurement. When the fixed projective measurement involves higher-rank projectors, the coherence resource is referred to as block coherence, which comes from the superposition of orthogonal subspaces. Here, we establish a set of quantitative relations for the interconversion between block coherence and multipartite entanglement under the framework of the block-incoherent operations. It is found that the converted multipartite entanglement is upper bounded by the initial block coherence of single-party system. Moreover, the generated multipartite entanglement can be transferred to its subsystems and restored to block coherence of the initial single-party system by means of local block-incoherent operations and classical communication. In addition, when only the coarse-grained quantum operations are accessible for the ancillary subsystems, we further demonstrate that a lossless resource interconversion is still realizable. Our results provide a versatile approach to utilize different quantum resources in a cyclic fashion.


title: On the structure of envy-free orientations on graphs

abstract: Fair division is the problem of allocating a set of items among agents in a fair manner. One of the most sought-after fairness notions is envy-freeness (EF), requiring that no agent envies another's allocation. When items are indivisible, it ceases to exist, and envy-freeness up to any good (EFX) emerged as one of its strongest relaxations. The existence of EFX allocations is arguably the biggest open question within fair division. Recently, Christodoulou, Fiat, Koutsoupias, and Sgouritsa (EC 2023) introduced showed that EFX allocations exist for the case of graphical valuations where an instance is represented by a graph: nodes are agents, edges are goods, and each agent values only her incident edges. On the other hand, they showed NP-hardness for checking the existence of EFX orientation where every edge is allocated to one of its incident vertices, and asked for a characterization of graphs that exhibit EFX orientation regardless of the assigned valuations. In this paper, we make significant progress toward answering their question. We introduce the notion of strongly EFX orientable graphs -- graphs that have EFX orientations regardless of how much agents value the edges. We show a surprising connection between this property and the chromatic number of the graph, namely $\chi(G)$ for graph $G$. In particular, we show that graphs with $\chi(G)\le 2$ are strongly EFX orientable, and those with $\chi(G)>3$ are not strongly EFX orientable. We provide examples of strongly EFX orientable and non-strongly EFX orientable graphs of $\chi(G)=3$ to prove tightness. Finally, we give a complete characterization of strong EFX orientability when restricted to binary valuations.


title: SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile

abstract: This work is motivated by recent developments in Deep Neural Networks, particularly the Transformer architectures underlying applications such as ChatGPT, and the need for performing inference on mobile devices. Focusing on emerging transformers (specifically the ones with computationally efficient Swin-like architectures) and large models (e.g., Stable Diffusion and LLMs) based on transformers, we observe that layout transformations between the computational operators cause a significant slowdown in these applications. This paper presents SmartMem, a comprehensive framework for eliminating most layout transformations, with the idea that multiple operators can use the same tensor layout through careful choice of layout and implementation of operations. Our approach is based on classifying the operators into four groups, and considering combinations of producer-consumer edges between the operators. We develop a set of methods for searching such layouts. Another component of our work is developing efficient memory layouts for 2.5 dimensional memory commonly seen in mobile devices. Our experimental results show that SmartMem outperforms 5 state-of-the-art DNN execution frameworks on mobile devices across 18 varied neural networks, including CNNs, Transformers with both local and global attention, as well as LLMs. In particular, compared to DNNFusion, SmartMem achieves an average speedup of 2.8$\times$, and outperforms TVM and MNN with speedups of 6.9$\times$ and 7.9$\times$, respectively, on average.


title: Towards Parameter-free Distributed Optimization: a Port-Hamiltonian Approach

abstract: This paper introduces a novel distributed optimization technique for networked systems, which removes the dependency on specific parameter choices, notably the learning rate. Traditional parameter selection strategies in distributed optimization often lead to conservative performance, characterized by slow convergence or even divergence if parameters are not properly chosen. In this work, we propose a systems theory tool based on the port-Hamiltonian formalism to design algorithms for consensus optimization programs. Moreover, we propose the Mixed Implicit Discretization (MID), which transforms the continuous-time port-Hamiltonian system into a discrete time one, maintaining the same convergence properties regardless of the step size parameter. The consensus optimization algorithm enhances the convergence speed without worrying about the relationship between parameters and stability. Numerical experiments demonstrate the method's superior performance in convergence speed, outperforming other methods, especially in scenarios where conventional methods fail due to step size parameter limitations.


title: Listen Then See: Video Alignment with Speaker Attention

abstract: Video-based Question Answering (Video QA) is a challenging task and becomes even more intricate when addressing Socially Intelligent Question Answering (SIQA). SIQA requires context understanding, temporal reasoning, and the integration of multimodal information, but in addition, it requires processing nuanced human behavior. Furthermore, the complexities involved are exacerbated by the dominance of the primary modality (text) over the others. Thus, there is a need to help the task's secondary modalities to work in tandem with the primary modality. In this work, we introduce a cross-modal alignment and subsequent representation fusion approach that achieves state-of-the-art results (82.06\% accuracy) on the Social IQ 2.0 dataset for SIQA. Our approach exhibits an improved ability to leverage the video modality by using the audio modality as a bridge with the language modality. This leads to enhanced performance by reducing the prevalent issue of language overfitting and resultant video modality bypassing encountered by current existing techniques. Our code and models are publicly available at https://github.com/sts-vlcc/sts-vlcc


title: Splitting Techniques for DAEs with port-Hamiltonian Applications

abstract: In the simulation of differential-algebraic equations (DAEs), it is essential to employ numerical schemes that take into account the inherent structure and maintain explicit or hidden algebraic constraints without altering them. This paper focuses on operator-splitting techniques for coupled systems and aims at preserving the structure in the port-Hamiltonian framework. The study explores two decomposition strategies: one considering the underlying coupled subsystem structure and the other addressing energy-associated properties such as conservation and dissipation. We show that for coupled index-$1$ DAEs with and without private index-2 variables, the splitting schemes on top of a dimension-reducing decomposition achieve the same convergence rate as in the case of ordinary differential equations. Additionally, we discuss an energy-associated decomposition for index-1 pH-DAEs and introduce generalized Cayley transforms to uphold energy conservation. The effectiveness of both strategies is evaluated using port-Hamiltonian benchmark examples from electric circuits.