title: Neural Auctions Compromise Bidder Information

abstract: Single-shot auctions are commonly used as a means to sell goods, for example when selling ad space or allocating radio frequencies, however devising mechanisms for auctions with multiple bidders and multiple items can be complicated. It has been shown that neural networks can be used to approximate optimal mechanisms while satisfying the constraints that an auction be strategyproof and individually rational. We show that despite such auctions maximizing revenue, they do so at the cost of revealing private bidder information. While randomness is often used to build in privacy, in this context it comes with complications if done without care. Specifically, it can violate rationality and feasibility constraints, fundamentally change the incentive structure of the mechanism, and/or harm top-level metrics such as revenue and social welfare. We propose a method that employs stochasticity to improve privacy while meeting the requirements for auction mechanisms with only a modest sacrifice in revenue. We analyze the cost to the auction house that comes with introducing varying degrees of privacy in common auction settings. Our results show that despite current neural auctions' ability to approximate optimal mechanisms, the resulting vulnerability that comes with relying on neural networks must be accounted for.


title: Study of the Inflationary Spectrum in the Presence of Quantum Gravity Corrections

abstract: After a brief review of the different approaches to predict the possible quantum gravity corrections to quantum field theory, we discuss in some detail the formulation based on a Gaussian reference frame fixing. Then, we implement this scenario to the determination of the inflationary spectrum of primordial perturbations. We consider the quantization of an inhomogeneous free massless scalar field on a quasi-classical isotropic Universe, developing a WKB expansion of the dynamics at the next order in the Planckian parameter, with respect to the one at which standard QFT emerges. The quantum gravity corrections to the scale invariant spectrum are discussed in a specific primordial cosmological setting and then in a general minisuperspace formalism, showing that there is no mode-dependent effect and thus the scale invariant inflationary spectrum is preserved. Such result is discussed in connection to the absence of a matter backreaction on the gravitational background in the considered paradigm.


title: A variant of Siegel's theorem for Drinfeld modules

abstract: We complete the proof of a Siegel type statement for finitely generated $\Phi$-submodules of $\mathbb{G}_a$ under the action of a Drinfeld module $\Phi$.


title: Deeply-virtual Compton process $e^- N \to e^- \gamma \pi N$ to study nucleon to resonance transitions

abstract: We study the deeply-virtual Compton scattering (DVCS) process $e^- N \to e^- \gamma \pi N$ involving the transition between a nucleon and a nucleon resonance in the $\pi N$ system, within the framework of generalized parton distributions (GPDs). For the four lowest-lying nucleon resonances, $\Delta(1232)$, $P_{11}(1440)$, $D_{13}(1520)$, and $S_{11}(1535)$, we express the DVCS amplitude in the Bjorken limit in terms of corresponding nucleon-to-resonance GPDs. Building upon the knowledge of the well studied electromagnetic nucleon-to-resonance transition form factors, which map the quark charge densities in transverse position space, the corresponding GPDs will open the prospect to also access the longitudinal momentum distributions of quarks in the transition. We provide estimates for cross sections and beam-spin asymmetries in the first and second $\pi N$ resonance regions in the kinematics of forthcoming CLAS12 data from Jefferson Lab.


title: The LMC+ SOFIA Legacy Program

abstract: With the goal of elucidating the effects of low metallicity on the star formation activity, feedback and interstellar medium of low metallicity environments, SOFIA has observed a 40' x 20' (60 pc x 30 pc) area of our neighboring metal-poor Large Magellanic Cloud in 158 micron [CII] and 88 micron [OIII], targeting the southern molecular ridge just south of 30Doradus. We find extensive [CII] emission over the region, which encompasses a wide variety of local physical conditions, from bright compact star forming regions to lower density environments beyond, much of which does not correspond to CO structures. Preliminary analyses indicates that most of the molecular hydrogen is in a CO-dark gas component.


title: Laser calibration of the ATLAS Tile Calorimeter during LHC Run 2

abstract: This article reports the laser calibration of the hadronic Tile Calorimeter of the ATLAS experiment in the LHC Run 2 data campaign. The upgraded Laser II calibration system is described. The system was commissioned during the first LHC Long Shutdown, exhibiting a stability better than 0.8% for the laser light monitoring. The methods employed to derive the detector calibration factors with data from the laser calibration runs are also detailed. These allowed to correct for the response fluctuations of the 9852 photomultiplier tubes of the Tile Calorimeter with a total uncertainty of 0.5% plus a luminosity-dependent sub-dominant term. Finally, we report the regular monitoring and performance studies using laser events in both standalone runs and during proton collisions. These studies include channel timing and quality inspection, and photomultiplier linearity and response dependence on anode current.


title: Optimization and Amplification of Cache Side Channel Signals

abstract: In cache-based side channel attacks, an attacker infers information about the victim based on the presence, or lack thereof, of one or more cachelines. Determining a cacheline's presence, which we refer to as "reading the signal", typically requires testing the access time of the line using a suitably high precision timer. In this paper we introduce novel gadgets which leverage CPU speculation to enable modification of these signals, before they are read, for a variety of purposes. First, these gadgets enable an attacker to optimize cache-based side channel attacks by evaluating arbitrary logic functions on cacheline signals prior to their measurement. Second, we demonstrate amplification techniques that enable an attacker to read a signal even if no high precision timer is available. Combined, these techniques can be used to improve existing side channel attacks even if timer access is limited. We evaluate the effectiveness of these techniques on a modern x86 CPU and demonstrate that when properly tuned, cache side channel signals can be reliably modified with near 100% accuracy and are able to be read with a timer as coarse as 100ms or more.


title: QCLAB++: Simulating Quantum Circuits on GPUs

abstract: We introduce qclab++, a light-weight, fully-templated C++ package for GPU-accelerated quantum circuit simulations. The code offers a high degree of portability as it has no external dependencies and the GPU kernels are generated through OpenMP offloading. qclab++ is designed for performance and numerical stability through highly optimized gate simulation algorithms for 1-qubit, controlled 1-qubit, and 2-qubit gates. Furthermore, we also introduce qclab, a quantum circuit toolbox for Matlab with a syntax that mimics qclab++. This provides users the flexibility and ease of use of a scripting language like Matlab for studying their quantum algorithms, while offering high-performance GPU acceleration when required. As such, the qclab++ library offers a unique combination of features. We compare the CPU simulator in qclab++ with the GPU kernels generated by OpenMP and observe a speedup of over $40\times$. Furthermore, we also compare qclab++ to other circuit simulation packages, such as cirq-qsim and qibo, in a series of benchmarks conducted on NERSC's Perlmutter system and illustrate its competitiveness.


title: Tilted Dirac cones and topological transitions in strained kagome lattices

abstract: We study effects of strain on the electronic properties of the kagome lattice in a tight-binding formalism with spin-orbit coupling (SOC). The degeneracy at the $\Gamma$ point evolves into a pair of emergent tilted Dirac cones under uniaxial strain, where the anisotropy and tilting of the bands depend on the magnitude and direction of the strain field. SOC opens gaps at the emergent Dirac points, making the flatband topological, characterized by a nontrivial $\mathbb{Z}_2$ index. Strains of a few percent drive the system into trivial or topological phases. This confirms that moderate strain can be used to engineer anisotropic Dirac bands with tunable properties to study new phases in kagome lattices.


title: Strong-coupling magnetophononics: Self-blocking, phonon-bitriplons, and spin-band engineering

abstract: Magnetophononics, the modulation of magnetic interactions by driving infrared-active lattice excitations, is emerging as a key mechanism for the ultrafast dynamical control of both semiclassical and quantum spin systems by coherent light. We demonstrate that, in a quantum magnet with strong spin-phonon coupling, resonances between the driven phonon and the spin excitation frequencies exhibit an intrinsic self-blocking effect, whereby only a fraction of the available laser power is absorbed by the phonon. Using the quantum master equations governing the nonequilibrium steady states of the coupled spin-lattice system, we show how self-blocking arises from the self-consistent alteration of the resonance frequencies. We link this to the appearance of mutually repelling collective spin-phonon states, which in the regime of strong hybridization become composites of a phonon and two triplons. We then identify the mechanism and optimal phonon frequencies by which to control a global nonequilibrium renormalization of the lattice-driven spin excitation spectrum and demonstrate that this effect should be observable in ultrafast THz experiments on a number of known quantum magnetic materials.


title: Using holographic microscopy to measure the effect of confinement on crowding agents in lipid vesicles

abstract: The hydrodynamic effects of macromolecular crowding inside cells is often studied in vitro by using polymers as crowding reagents. Confinement of polymers inside cell-sized droplets has been shown to affect the diffusion of small molecules. Here we develop a method, based on digital holographic microscopy, to measure the diffusion of polystyrene microspheres that are confined within lipid vesicles containing a high concentration of solute. We apply the method to three solutes of varying complexity: sucrose, dextran, and PEG, prepared at ~7 % (w/w). We find that diffusion inside and outside the vesicles is the same when the solute is sucrose or dextran that is prepared below the critical overlap concentration. For polyethylene glycol, which is present at a concentration higher than the critical overlap concentration, the diffusion of microspheres inside vesicles is slower, hinting at the potential effects of confinement on crowding agents.


title: Ab Initio Investigation of Intramolecular Charge Transfer States in DMABN by Calculation of Excited State X-ray Absorption Spectra

abstract: Dual fluorescence in 4-(dimethylamino)benzonitrile (DMABN) and its derivatives in polar solvents has been studied extensively for the past several decades. An intramolecular charge transfer (ICT) minimum on the excited state potential energy surface, in addition to the localized low-energy (LE) minimum, has been proposed as a mechanism for this dual fluorescence, with large geometric relaxation and molecular orbital reorganization a key feature of the ICT pathway. Herein, we have used both equation-of-motion coupled-cluster with single and double excitations (EOM-CCSD) and time-dependent density functional (TDDFT) methods to investigate the landscape of excited state potential energy surfaces across a number of geometric conformations proposed as ICT structures. In order to correlate these geometries and valence excited states in terms of potential experimental observables, we have calculated the nitrogen K-edge ground and excited state absorption spectra for each of the predicted "signpost" structures, and identified several key spectral features which could be used to interpret a future time-resolved x-ray absorption experiment.


title: Representation Disentaglement via Regularization by Causal Identification

abstract: In this work, we propose the use of a causal collider structured model to describe the underlying data generative process assumptions in disentangled representation learning. This extends the conventional i.i.d. factorization assumption model $p(\mathbf{y}) = \prod_{i} p(\mathbf{y}_i )$, inadequate to handle learning from biased datasets (e.g., with sampling selection bias). The collider structure, explains that conditional dependencies between the underlying generating variables may be exist, even when these are in reality unrelated, complicating disentanglement. Under the rubric of causal inference, we show this issue can be reconciled under the condition of causal identification; attainable from data and a combination of constraints, aimed at controlling the dependencies characteristic of the \textit{collider} model. For this, we propose regularization by identification (ReI), a modular regularization engine designed to align the behavior of large scale generative models with the disentanglement constraints imposed by causal identification. Empirical evidence on standard benchmarks demonstrates the superiority of ReI in learning disentangled representations in a variational framework. In a real-world dataset we additionally show that our framework, results in interpretable representations robust to out-of-distribution examples and that align with the true expected effect from domain knowledge.


title: Cell Division and Motility Enable Hexatic Order in Biological Tissues

abstract: Biological tissues transform between solid-like and liquid-like states in many fundamental physiological events. Recent experimental observations further suggest that in two-dimensional epithelial tissues these solid-liquid transformations can happen via intermediate states akin to the intermediate hexatic phases observed in equilibrium two-dimensional melting. The hexatic phase is characterized by quasi-long-range (power-law) orientational order but no translational order, thus endowing some structure to an otherwise structureless fluid. While it has been shown that hexatic order in tissue models can be induced by motility and thermal fluctuations, the role of cell division and apoptosis (birth and death) has remained poorly understood, despite its fundamental biological role. Here we study the effect of cell division and apoptosis on global hexatic order within the framework of the self-propelled Voronoi model of tissue. Although cell division naively destroys order and active motility facilitates deformations, we show that their combined action drives a liquid-hexatic-liquid transformation as the motility increases. The hexatic phase is accessed by the delicate balance of dislocation defect generation from cell division and the active binding of disclination-antidisclination pairs from motility. We formulate a mean-field model to elucidate this competition between cell division and motility and the consequent development of hexatic order.


title: Convergence of Leray Cosheaves for Decorated Mapper Graphs

abstract: We introduce decorated mapper graphs as a generalization of mapper graphs capable of capturing more topological information of a data set. A decorated mapper graph can be viewed as a discrete approximation of the cellular Leray cosheaf over the Reeb graph. We establish a theoretical foundation for this construction by showing that the cellular Leray cosheaf with respect to a sequence of covers converges to the actual Leray cosheaf as the resolution of the covers goes to zero.


title: A Low-Complexity Solution to Sum Rate Maximization for IRS-assisted SWIPT-MIMO Broadcasting

abstract: This paper focuses on the fundamental problem of maximizing the achievable weighted sum rate (WSR) at information receivers (IRs) in an intelligent reflecting surface (IRS) assisted simultaneous wireless information and power transfer system under a multiple-input multiple-output (SWIPT-MIMO) setting, subject to a quality-of-service (QoS) constraint at the energy receivers (ERs). Notably, due to the coupling between the transmit precoding matrix and the passive beamforming vector in the QoS constraint, the formulated non-convex optimization problem is challenging to solve. We first decouple the design variables in the constraints following a penalty dual decomposition method, and then apply an alternating gradient projection algorithm to achieve a stationary solution to the reformulated optimization problem. The proposed algorithm nearly doubles the WSR compared to that achieved by a block-coordinate descent (BCD) based benchmark scheme. At the same time, the complexity of the proposed scheme grows linearly with the number of IRS elements while that of the benchmark scheme is proportional to the cube of the number of IRS elements.


title: Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera

abstract: Deploying autonomous robots in crowded indoor environments usually requires them to have accurate dynamic obstacle perception. Although plenty of previous works in the autonomous driving field have investigated the 3D object detection problem, the usage of dense point clouds from a heavy Light Detection and Ranging (LiDAR) sensor and their high computation cost for learning-based data processing make those methods not applicable to small robots, such as vision-based UAVs with small onboard computers. To address this issue, we propose a lightweight 3D dynamic obstacle detection and tracking (DODT) method based on an RGB-D camera, which is designed for low-power robots with limited computing power. Our method adopts a novel ensemble detection strategy, combining multiple computationally efficient but low-accuracy detectors to achieve real-time high-accuracy obstacle detection. Besides, we introduce a new feature-based data association and tracking method to prevent mismatches utilizing point clouds' statistical features. In addition, our system includes an optional and auxiliary learning-based module to enhance the obstacle detection range and dynamic obstacle identification. The proposed method is implemented in a small quadcopter, and the results show that our method can achieve the lowest position error (0.11m) and a comparable velocity error (0.23m/s) across the benchmarking algorithms running on the robot's onboard computer. The flight experiments prove that the tracking results from the proposed method can make the robot efficiently alter its trajectory for navigating dynamic environments. Our software is available on GitHub as an open-source ROS package.


title: The inter-play between asymmetric noise and coupling in a super-critical Hopf bifurcation

abstract: While the stochastic dynamics of two coupled oscillators have been extensively studied, most of the research has focused on stochastic input with equal intensity. However, this is often not the case in biological systems. In this study, we investigate the effects of intrinsic noise with unequal intensity on a pair of diffusively coupled lambda-omega oscillators that are quiescent without noise but become excitable with the addition of a noise stimulus. Our findings demonstrate that unequal noise can play a constructive role in inducing phase synchronization (PS) in coupled oscillators. Additionally, we show that PS can be optimized by moving the model closer to the bifurcation point/excitation threshold. This study emphasizes the significance of examining asymmetric stochasticity between oscillators and provides valuable insight into how unequal noise intensity can be utilized to promote PS.


title: Su-Schrieffer-Hegger (SSH) model with non-orientable bulk: Union of topology and flat bands in one dimension

abstract: In this letter we summarise our study of Su-Schrieffer-Hegger(SSH) model with a one dimensional non-orientable manifold as bulk. For this purpose a SSH model with any bulk (SAB) is introduced. We observe the following: (1) The topology of the SSH model is preserved even with a non-orientable bulk, (2) The appearance of a doubly degenerate flat band exactly at the Fermi level, (3) At half filling the band structure is metallic due to the complete overlap of valence and conduction band but the electrons will be localised because the bands are flat and (4) This system is unique because it has flat bands and at the same time is topologically non-trivial.


title: Deep learning for COVID-19 topic modelling via Twitter: Alpha, Delta and Omicron

abstract: Topic modelling with innovative deep learning methods has gained interest for a wide range of applications that includes COVID-19. Topic modelling can provide, psychological, social and cultural insights for understanding human behaviour in extreme events such as the COVID-19 pandemic. In this paper, we use prominent deep learning-based language models for COVID-19 topic modelling taking into account data from emergence (Alpha) to the Omicron variant. We apply topic modeling to review the public behaviour across the first, second and third waves based on Twitter dataset from India. Our results show that the topics extracted for the subsequent waves had certain overlapping themes such as covers governance, vaccination, and pandemic management while novel issues aroused in political, social and economic situation during COVID-19 pandemic. We also found a strong correlation of the major topics qualitatively to news media prevalent at the respective time period. Hence, our framework has the potential to capture major issues arising during different phases of the COVID-19 pandemic which can be extended to other countries and regions.


title: On the tightness of graph-based statistics

abstract: We establish tightness of graph-based stochastic processes in the space $D[0+\epsilon,1-\epsilon]$ with $\epsilon >0$ that allows for discontinuities of the first kind. The graph-based stochastic processes are based on statistics constructed from similarity graphs. In this setting, the classic characterization of tightness is intractable, making it difficult to obtain convergence of the limiting distributions for graph-based stochastic processes. We take an alternative approach and study the behavior of the higher moments of the graph-based test statistics. We show that, under mild conditions of the graph, tightness of the stochastic process can be established by obtaining upper bounds on the graph-based statistics' higher moments. Explicit analytical expressions for these moments are provided. The results are applicable to generic graphs, including dense graphs where the number of edges can be of higher order than the number of observations.


title: PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositing

abstract: Lighting effects such as shadows or reflections are key in making synthetic images realistic and visually appealing. To generate such effects, traditional computer graphics uses a physically-based renderer along with 3D geometry. To compensate for the lack of geometry in 2D Image compositing, recent deep learning-based approaches introduced a pixel height representation to generate soft shadows and reflections. However, the lack of geometry limits the quality of the generated soft shadows and constrain reflections to pure specular ones. We introduce PixHt-Lab, a system leveraging an explicit mapping from pixel height representation to 3D space. Using this mapping, PixHt-Lab reconstructs both the cutout and background geometry and renders realistic, diverse, lighting effects for image compositing. Given a surface with physically-based materials, we can render reflections with varying glossiness. To generate more realistic soft shadows, we further propose to use 3D-aware buffer channels to guide a neural renderer. Both quantitative and qualitative evaluations demonstrate that PixHt-Lab significantly improves soft shadow generation.


title: Texture-Based Input Feature Selection for Action Recognition

abstract: The performance of video action recognition has been significantly boosted by using motion representations within a two-stream Convolutional Neural Network (CNN) architecture. However, there are a few challenging problems in action recognition in real scenarios, e.g., the variations in viewpoints and poses, and the changes in backgrounds. The domain discrepancy between the training data and the test data causes the performance drop. To improve the model robustness, we propose a novel method to determine the task-irrelevant content in inputs which increases the domain discrepancy. The method is based on a human parsing model (HP model) which jointly conducts dense correspondence labelling and semantic part segmentation. The predictions from the HP model also function as re-rendering the human regions in each video using the same set of textures to make humans appearances in all classes be the same. A revised dataset is generated for training and testing and makes the action recognition model exhibit invariance to the irrelevant content in the inputs. Moreover, the predictions from the HP model are used to enrich the inputs to the AR model during both training and testing. Experimental results show that our proposed model is superior to existing models for action recognition on the HMDB-51 dataset and the Penn Action dataset.


title: Exact $(1 + 3 + 6)$-dimensional cosmological-type solutions in gravitational model with Yang-Mills field, Gauss-Bonnet term and $\Lambda$-term

abstract: We consider $10$-dimensional gravitational model with $SO(6)$ Yang-Mills field, Gauss-Bonnet term and $\Lambda$-term. We study so-called cosmological type solutions defined on product manifold $M = R \times R^3 \times K$, where $K$ is $6d$ Calabi-Yau manifold. By putting the gauge field 1-form to be coinciding with 1-form spin connection on $K$, we obtain exact cosmological solutions with exponential dependence of scale factors (upon $t$-variable), governed by two non-coinciding Hubble-like parameters: $H >0$, $h$, obeying $ H + 2 h \neq 0$. We also present static analogs of these cosmological solutions (for $H \neq 0$, $h \neq H$ and $ H + 2 h \neq 0$). The islands of stability for both classes of solutions are outlined.


title: The limiting behavior of solutions to p-Laplacian problems with convection and exponential terms

abstract: We consider, for $a,l\geq1,$ $b,s,\alpha>0,$ and $p>q\geq1,$ the homogeneous Dirichlet problem for the equation $-\Delta_{p}u=\lambda u^{q-1}+\beta u^{a-1}\left\vert \nabla u\right\vert ^{b}+mu^{l-1}e^{\alpha u^{s}}$ in a smooth bounded domain $\Omega\subset\mathbb{R}^{N}.$ We prove that under certain setting of the parameters $\lambda,$ $\beta$ and $m$ the problem admits at least one positive solution. Using this result we prove that if $\lambda,\beta>0$ are arbitrarily fixed and $m$ is sufficiently small, then the problem has a positive solution $u_{p},$ for all $p$ sufficiently large. In addition, we show that $u_{p}$ converges uniformly to the distance function to the boundary of $\Omega,$ as $p\rightarrow\infty.$ This convergence result is new for nonlinearities involving a convection term.


title: Containing a spread through sequential learning: to exploit or to explore?

abstract: The spread of an undesirable contact process, such as an infectious disease (e.g. COVID-19), is contained through testing and isolation of infected nodes. The temporal and spatial evolution of the process (along with containment through isolation) render such detection as fundamentally different from active search detection strategies. In this work, through an active learning approach, we design testing and isolation strategies to contain the spread and minimize the cumulative infections under a given test budget. We prove that the objective can be optimized, with performance guarantees, by greedily selecting the nodes to test. We further design reward-based methodologies that effectively minimize an upper bound on the cumulative infections and are computationally more tractable in large networks. These policies, however, need knowledge about the nodes' infection probabilities which are dynamically changing and have to be learned by sequential testing. We develop a message-passing framework for this purpose and, building on that, show novel tradeoffs between exploitation of knowledge through reward-based heuristics and exploration of the unknown through a carefully designed probabilistic testing. The tradeoffs are fundamentally distinct from the classical counterparts under active search or multi-armed bandit problems (MABs). We provably show the necessity of exploration in a stylized network and show through simulations that exploration can outperform exploitation in various synthetic and real-data networks depending on the parameters of the network and the spread.


title: Robustness of Energy Landscape Controllers for Spin Rings under Coherent Excitation Transport

abstract: The design and analysis of controllers to regulate excitation transport in quantum spin rings presents challenges in the application of classical feedback control techniques to synthesize effective control, and generates results in contradiction to the expectations of classical control theory. In this paper, we examine the robustness of controllers designed to optimize the fidelity of an excitation transfer to uncertainty in system and control parameters. We use the logarithmic sensitivity of the fidelity error as the measure of robustness, drawing on the classical control analog of the sensitivity of the tracking error. In our analysis we demonstrate that quantum systems optimized for coherent transport demonstrate significantly different correlation between error and the log-sensitivity depending on whether the controller is optimized for readout at an exact time T or over a time-window about T.


title: Hecke Actions on Loops and Periods of Iterated Shimura Integrals

abstract: In this paper we show that the action of the classical Hecke operators T_N, N>0, act on the free abelian groups generated by the conjugacy classes of the modular group SL_2(Z) and the conjugacy classes of its profinite completion. We show that this action induces a dual action on the ring of class functions of a certain relative unipotent completion of the modular group. This ring contains all iterated integrals of modular forms that are constant on conjugacy classes. It possesses a natural mixed Hodge structure and, after tensoring with Q_ell$, a natural action of the absolute Galois group. Each Hecke operator preserves this mixed Hodge structure and commutes with the action of the absolute Galois group. Unlike in the classical case, the algebra generated by these Hecke operators is not commutative. The appendix by Pham Tiep is not included. It can be found at arXiv:2303.02807.


title: ${\rm cl}$-prereductions, ${\rm i}$-postexpansions, and related structures

abstract: Expanding on the work of Kemp, Ratliff and Shah, for any closure ${\rm cl}$ defined on a class of modules over a Noetherian ring, we develop the theory of ${\rm cl}$-prereductions of submodules. For any interior ${\rm i}$ on a class of $R$-modules, we also develop the theory of {\rm i}-postexpansions. Using the duality of Epstein, R.G. and Vassilev, we show that if ${\rm i}$ is the interior dual to ${\rm cl}$, then these notions are in fact dual to each other. We consider the ${\rm cl}$-precore (${\rm i}$-postcore), the intersection of all ${\rm cl}$-prereductions ${\rm i}$-postexpansions) of a submodule and the ${\rm cl}$-prehull (${\rm i}$-posthull), the sum of all ${\rm cl}$-prereductions (${\rm i}$-postexpansions) of a submodule and give comparisons with the ${\rm cl}$-core (${\rm i}$-hull). We further give a classification of ${\rm cl}$-prereductions of ${\rm cl}$-closed ideals of a Noetherian ring where ${\rm cl}$ is a closure with a special part.


title: Mobile disks in hyperbolic space and minimization of conformal capacity

abstract: Our focus is to study constellations of disjoint disks in the hyperbolic space, the unit disk equipped with the hyperbolic metric. Each constellation corresponds to a set $E$ which is the union of $m>2$ disks with hyperbolic radii $r_j>0, j=1,...,m$. The centers of the disks are not fixed and hence individual disks of the constellation are allowed to move under the constraints that they do not overlap and their hyperbolic radii remain invariant. Our main objective is to find computational lower bounds for the conformal capacity of a given constellation. The capacity depends on the centers and radii in a very complicated way even in the simplest cases when $m=3$ or $m=4$. In the absence of analytic methods our work is based on numerical simulations using two different numerical methods, the boundary integral equation method and the $hp$-FEM method, resp. Our simulations combine capacity computation with minimization methods and produce extremal cases where the disks of the constellation are grouped next to each other. This resembles the behavior of animal colonies minimizing heat flow in arctic areas.


title: I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue

abstract: Current Spoken Dialogue Systems (SDSs) often serve as passive listeners that respond only after receiving user speech. To achieve human-like dialogue, we propose a novel future prediction architecture that allows an SDS to anticipate future affective reactions based on its current behaviors before the user speaks. In this work, we investigate two scenarios: speech and laughter. In speech, we propose to predict the user's future emotion based on its temporal relationship with the system's current emotion and its causal relationship with the system's current Dialogue Act (DA). In laughter, we propose to predict the occurrence and type of the user's laughter using the system's laughter behaviors in the current turn. Preliminary analysis of human-robot dialogue demonstrated synchronicity in the emotions and laughter displayed by the human and robot, as well as DA-emotion causality in their dialogue. This verifies that our architecture can contribute to the development of an anticipatory SDS.


title: Non-crossing Hamiltonian Paths and Cycles in Output-Polynomial Time

abstract: We show that, for planar point sets, the number of non-crossing Hamiltonian paths is polynomially bounded in the number of non-crossing paths, and the number of non-crossing Hamiltonian cycles (polygonalizations) is polynomially bounded in the number of surrounding cycles. As a consequence, we can list the non-crossing Hamiltonian paths or the polygonalizations, in time polynomial in the output size, by filtering the output of simple backtracking algorithms for non-crossing paths or surrounding cycles respectively. To prove these results we relate the numbers of non-crossing structures to two easily-computed parameters of the point set: the minimum number of points whose removal results in a collinear set, and the number of points interior to the convex hull. These relations also lead to polynomial-time approximation algorithms for the numbers of structures of all four types, accurate to within a constant factor of the logarithm of these numbers.


title: Adjacency-Like Conditions and Induced Ideal Graphs

abstract: In this paper we examine some natural ideal conditions and show how graphs can be defined that give a visualization of these conditions. We examine the interplay between the multiplicative ideal theory and the graph theoretic structure of the associated graph. Behavior of these graphs under standard ring extensions are studied, and in conjunction with the theory, some classical results and connections are made.


title: Stability and moduli space of generalized Ricci solitons

abstract: The generalized Einstein Hilbert action is an extension of the classic scalar curvature energy and Perelman F functional which incorporates a closed three-form. The critical points are known as generalized Ricci solitons, which arise naturally in mathematical physics, complex geometry, and generalized geometry. Through a delicate analysis of the group of generalized gauge transformations, and implementing a novel connection, we give a simple formula for the second variation of this energy which generalizes the Lichnerowicz operator in the Einstein case. As an application, we show that all Bismut flat manifolds are linearly stable critical points, and admit nontrivial deformations arising from Lie theory. Furthermore, this leads to extensions of classic results of Koiso and Podesta, Spiro, Kr\"oncke to the moduli space of generalized Ricci solitons. To finish we classify deformations of the Bismut-flat structure on S3 and show that some are integrable while others are not.


title: Variants on Digital Covering Maps

abstract: SE Han's paper [11] discusses several variants of digital covering maps. We show several equivalences among these variants and discuss shortcomings in Han's paper.


title: Exponential trichotomy and global linearization of non-autonomous differential equations

abstract: Hartman-Grobman theorem was initially extended to the non-autonomous cases by Palmer. Usually, dichotomy is an essential condition of Palmer's linearization theorem. Is Palmer's linearization theorem valid for the systems with trichotomy? In this paper, we obtain new versions of the linearization theorem if linear system admits exponential trichotomy on $\mathbb{R}$. { Furthermore, the equivalent function $\mathscr H(t,x)$ and its inverse $\mathscr L(t,y)$ of our linearization theorems are H\"{o}lder continuous}. In addition, if a system is periodic, we find the equivalent function $\mathscr H(t,x)$ and its inverse $\mathscr L(t,y)$ of our linearization theorems do not have periodicity or asymptotical periodicity. To the best of our knowledge, this is the first paper studying the linearization with exponential trichotomy.


title: Formal and Executable Semantics of the Ethereum Virtual Machine in Dafny

abstract: The Ethereum protocol implements a replicated state machine. The network participants keep track of the system state by: 1) agreeing on the sequence of transactions to be processed and 2) computing the state transitions that correspond to the sequence of transactions. Ethereum transactions are programs, called smart contracts, and computing a state transition requires executing some code. The Ethereum Virtual Machine (EVM) provides this capability and can execute programs written in EVM bytecode. We present a formal and executable semantics of the EVM written in the verification-friendly language Dafny: it provides (i) a readable, formal and verified specification of the semantics of the EVM; (ii) a framework to formally reason about bytecode.


title: SHIMM: A Versatile Seeing Monitor for Astronomy

abstract: Characterisation of atmospheric optical turbulence is crucial for the design and operation of modern ground-based optical telescopes. In particular, the effective application of adaptive optics correction on large and extremely large telescopes relies on a detailed knowledge of the prevailing atmospheric conditions, including the vertical profile of the optical turbulence strength and the atmospheric coherence timescale. The Differential Image Motion Monitor (DIMM) has been employed as a facility seeing monitor at many astronomical observing sites across the world for several decades, providing a reliable estimate of the seeing angle. Here we present the Shack-Hartmann Image Motion Monitor (SHIMM), which is a development of the DIMM instrument, in that it exploits differential image motion measurements of bright target stars. However, the SHIMM employs a Shack-Hartmann wavefront sensor in place of the two-hole aperture mask utilised by the DIMM. This allows the SHIMM to provide an estimate of the seeing, unbiased by shot noise or scintillation effects. The SHIMM also produces a low-resolution (three-layer) measure of the vertical turbulence profile, as well as an estimate of the coherence timescale. The SHIMM is designed as a low-cost, portable, instrument. It is comprised of off-the-shelf components so that it is easy to duplicate and well-suited for comparisons of atmospheric conditions within and between different observing sites. Here, the SHIMM design and methodology for estimating key atmospheric parameters will be presented, as well as initial field test results with comparisons to the Stereo-SCIDAR instrument.


title: Neural inverse procedural modeling of knitting yarns from images

abstract: We investigate the capabilities of neural inverse procedural modeling to infer high-quality procedural yarn models with fiber-level details from single images of depicted yarn samples. While directly inferring all parameters of the underlying yarn model based on a single neural network may seem an intuitive choice, we show that the complexity of yarn structures in terms of twisting and migration characteristics of the involved fibers can be better encountered in terms of ensembles of networks that focus on individual characteristics. We analyze the effect of different loss functions including a parameter loss to penalize the deviation of inferred parameters to ground truth annotations, a reconstruction loss to enforce similar statistics of the image generated for the estimated parameters in comparison to training images as well as an additional regularization term to explicitly penalize deviations between latent codes of synthetic images and the average latent code of real images in the latent space of the encoder. We demonstrate that the combination of a carefully designed parametric, procedural yarn model with respective network ensembles as well as loss functions even allows robust parameter inference when solely trained on synthetic data. Since our approach relies on the availability of a yarn database with parameter annotations and we are not aware of such a respectively available dataset, we additionally provide, to the best of our knowledge, the first dataset of yarn images with annotations regarding the respective yarn parameters. For this purpose, we use a novel yarn generator that improves the realism of the produced results over previous approaches.


title: Exponential Consensus of Multiple Agents over Dynamic Network Topology: Controllability, Connectivity, and Compactness

abstract: This paper investigates the problem of securing exponentially fast consensus (exponential consensus for short) for identical agents with finite-dimensional linear system dynamics over dynamic network topology. Our aim is to find the weakest possible conditions that guarantee exponentially fast consensus using a Lyapunov function consisting of a sum of terms of the same functional form. We first investigate necessary conditions, starting by examining the system (both agent and network) parameters. It is found that controllability of the linear agents is necessary for reaching consensus. Then, to work out necessary conditions incorporating the network topology, we construct a set of Laplacian matrix-valued functions. The precompactness of this set of functions is shown to be a significant generalization of existing assumptions on network topology, including the common assumption that the edge weights are bounded piecewise constant functions or continuous functions. With the aid of such a precompactness assumption and restricting the Lyapunov function to one consisting of a sum of terms of the same functional form, we prove that a joint $(\delta, T)$-connectivity condition on the network topology is necessary for exponential consensus. Finally, we investigate how the above two ``necessities'' work together to guarantee exponential consensus. To partially address this problem, we define a synchronization index to characterize the interplay between agent parameters and network topology. Based on this notion, it is shown that by designing a proper feedback matrix and under the precompactness assumption, exponential consensus can be reached globally and uniformly if the joint $(\delta,T)$-connectivity and controllability conditions are satisfied, and the synchronization index is not less than one.


title: An unitary representation of inhomogeneous ${\rm SL}(2,\mathbb{C})$ using surfaces in $\mathbb{R}^4$

abstract: We will construct a non-separable Hilbert space for which the inhomogeneous ${\rm SL}(2,\mathbb{C})$ acts on it unitarily. Each vector in this Hilbert space is described by a (rectangular) space-like surface in $\mathbb{R}^4$, for which a frame consisting of a time-like vector and a space-like vector, and a vector field is defined on it. The inner product on this Hilbert space is defined via a surface integral, which is associated with the area of the surface.


title: Semi-supervised Parametric Real-world Image Harmonization

abstract: Learning-based image harmonization techniques are usually trained to undo synthetic random global transformations applied to a masked foreground in a single ground truth photo. This simulated data does not model many of the important appearance mismatches (illumination, object boundaries, etc.) between foreground and background in real composites, leading to models that do not generalize well and cannot model complex local changes. We propose a new semi-supervised training strategy that addresses this problem and lets us learn complex local appearance harmonization from unpaired real composites, where foreground and background come from different images. Our model is fully parametric. It uses RGB curves to correct the global colors and tone and a shading map to model local variations. Our method outperforms previous work on established benchmarks and real composites, as shown in a user study, and processes high-resolution images interactively.


title: HyScale-GNN: A Scalable Hybrid GNN Training System on Single-Node Heterogeneous Architecture

abstract: Graph Neural Networks (GNNs) have shown success in many real-world applications that involve graph-structured data. Most of the existing single-node GNN training systems are capable of training medium-scale graphs with tens of millions of edges; however, scaling them to large-scale graphs with billions of edges remains challenging. In addition, it is challenging to map GNN training algorithms onto a computation node as state-of-the-art machines feature heterogeneous architecture consisting of multiple processors and a variety of accelerators. We propose HyScale-GNN, a novel system to train GNN models on a single-node heterogeneous architecture. HyScale- GNN performs hybrid training which utilizes both the processors and the accelerators to train a model collaboratively. Our system design overcomes the memory size limitation of existing works and is optimized for training GNNs on large-scale graphs. We propose a two-stage data pre-fetching scheme to reduce the communication overhead during GNN training. To improve task mapping efficiency, we propose a dynamic resource management mechanism, which adjusts the workload assignment and resource allocation during runtime. We evaluate HyScale-GNN on a CPU-GPU and a CPU-FPGA heterogeneous architecture. Using several large-scale datasets and two widely-used GNN models, we compare the performance of our design with a multi-GPU baseline implemented in PyTorch-Geometric. The CPU-GPU design and the CPU-FPGA design achieve up to 2.08x speedup and 12.6x speedup, respectively. Compared with the state-of-the-art large-scale multi-node GNN training systems such as P3 and DistDGL, our CPU-FPGA design achieves up to 5.27x speedup using a single node.


title: Infinite-dimensional Lie bialgebras via affinization of Novikov bialgebras and Koszul duality

abstract: Balinsky and Novikov showed that the affinization of a Novikov algebra naturally defines a Lie algebra, a property that in fact characterizes the Novikov algebra. It is also an instance of the operadic Koszul duality. In this paper, we develop a bialgebra theory for the Novikov algebra, namely the Novikov bialgebra, which is characterized by the fact that its affinization (by a quadratic right Novikov algebra) gives an infinite-dimensional Lie bialgebra, suggesting a Koszul duality for properads. A Novikov bialgebra is also characterized as a Manin triple of Novikov algebras. The notion of Novikov Yang-Baxter equation is introduced, whose skewsymmetric solutions can be used to produce Novikov bialgebras and hence Lie bialgebras. Moreover, these solutions also give rise to skewsymmetric solutions of the classical Yang-Baxter equation in the infinite-dimensional Lie algebras from the Novikov algebras.


title: On Parametric Misspecified Bayesian Cram\'{e}r-Rao bound: An application to linear Gaussian systems

abstract: A lower bound is an important tool for predicting the performance that an estimator can achieve under a particular statistical model. Bayesian bounds are a kind of such bounds which not only utilizes the observation statistics but also includes the prior model information. In reality, however, the true model generating the data is either unknown or simplified when deriving estimators, which motivates the works to derive estimation bounds under modeling mismatch situations. This paper provides a derivation of a Bayesian Cram\'{e}r-Rao bound under model misspecification, defining important concepts such as pseudotrue parameter that were not clearly identified in previous works. The general result is particularized in linear and Gaussian problems, where closed-forms are available and results are used to validate the results.


title: Initial experiences with Direct Imaging of Neuronal Activity (DIANA) in humans

abstract: Functional MRI (fMRI) has been widely used to study activity patterns in the human brain. It infers neuronal activity from the associated hemodynamic response, which fundamentally limits its spatial and temporal specificity. In mice, the Direct Imaging of Neuronal Activity (DIANA) method revealed MRI signals that correlated with intracellular voltage changes, showing high spatial and temporal specificity. In this work we attempted DIANA in humans. Four visual paradigms were tested, exploring different stimulus types (flickering noise patterns, and naturalistic images) and stimulus durations (50-200ms). Regions of interest (ROI) were derived from traditional fMRI acquisitions and anatomical scans. When using small manually drawn ROI, signals were detected that resembled possible functional activity. However, increasing the stimulus duration did not lead to corroborating signal changes. Moreover, these signals disappeared when averaged over larger functionally or anatomically derived ROI. Further analysis of the data highlighted, DIANA's sensitivity to inflow effects and subject motion. Therefore, care should be taken not to mistake artifacts for neuronal activity. Although we did not yet observe clear DIANA signals in humans, it is possible that a higher spatial resolution is needed to separate signals with opposite signs in different laminar compartments. However, obtaining such data may be particularly challenging because repetitive experiments with short interstimulus intervals can be strenuous for the subjects. To obtain better data, improvements in sequence and stimulus designs are needed to maximize the DIANA signal and minimize confounds. However, without a clear understanding of DIANA's biophysical underpinnings it is difficult to do so. Therefore, it may be more effective to first study DIANA's biophysical underpinnings in a controlled, yet biologically revenant, setting.


title: Intrinsic and Measured Information in Separable Quantum Processes

abstract: Stationary quantum information sources emit sequences of correlated qudits -- that is, structured quantum stochastic processes. If an observer performs identical measurements on a qudit sequence, the outcomes are a realization of a classical stochastic process. We introduce quantum-information-theoretic properties for separable qudit sequences that serve as bounds on the classical information properties of subsequent measured processes. For sources driven by hidden Markov dynamics we describe how an observer can temporarily or permanently synchronize to the source's internal state using specific positive operator-valued measures or adaptive measurement protocols. We introduce a method for approximating an information source with an independent and identically-distributed, Markov, or larger memory model through tomographic reconstruction. We identify broad classes of separable processes based on their quantum information properties and the complexity of measurements required to synchronize to and accurately reconstruct them.

categories: quant-ph cond-mat.stat-mech cs.IT math.DS math.IT


title: Tuning to non-veridical features in attention and perceptual decision-making

abstract: When searching for a lost item, we tune attention to the known properties of the object. Previously, it was believed that attention is tuned to the veridical attributes of the search target (e.g., orange), or an attribute that is slightly shifted away from irrelevant features towards a value that can more optimally distinguish the target from the distractors (e.g., red-orange; optimal tuning). However, recent studies showed that attention is often tuned to the relative feature of the search target (e.g., redder), so that all items that match the relative features of the target equally attract attention (e.g., all redder items; relational account). Optimal tuning was shown to occur only at a later stage of identifying the target. However, the evidence for this division mainly relied on eye tracking studies that assessed the first eye movements. The present study tested whether this division can also be observed when the task is completed with covert attention and without moving the eyes. We used the N2pc in the EEG of participants to assess covert attention, and found comparable results: Attention was initially tuned to the relative colour of the target, as shown by a significantly larger N2pc to relatively matching distractors than a target-coloured distractor. However, in the response accuracies, a slightly shifted, "optimal" distractor interfered most strongly with target identification. These results confirm that early (covert) attention is tuned to the relative properties of an item, in line with the relational account, while later decision-making processes may be biased to optimal features.


title: A Mixed-Methods Approach to Understanding User Trust after Voice Assistant Failures

abstract: Despite huge gains in performance in natural language understanding via large language models in recent years, voice assistants still often fail to meet user expectations. In this study, we conducted a mixed-methods analysis of how voice assistant failures affect users' trust in their voice assistants. To illustrate how users have experienced these failures, we contribute a crowdsourced dataset of 199 voice assistant failures, categorized across 12 failure sources. Relying on interview and survey data, we find that certain failures, such as those due to overcapturing users' input, derail user trust more than others. We additionally examine how failures impact users' willingness to rely on voice assistants for future tasks. Users often stop using their voice assistants for specific tasks that result in failures for a short period of time before resuming similar usage. We demonstrate the importance of low stakes tasks, such as playing music, towards building trust after failures.


title: Diffusion Probabilistic Fields

abstract: Diffusion probabilistic models have quickly become a major approach for generative modeling of images, 3D geometry, video and other domains. However, to adapt diffusion generative modeling to these domains the denoising network needs to be carefully designed for each domain independently, oftentimes under the assumption that data lives in a Euclidean grid. In this paper we introduce Diffusion Probabilistic Fields (DPF), a diffusion model that can learn distributions over continuous functions defined over metric spaces, commonly known as fields. We extend the formulation of diffusion probabilistic models to deal with this field parametrization in an explicit way, enabling us to define an end-to-end learning algorithm that side-steps the requirement of representing fields with latent vectors as in previous approaches (Dupont et al., 2022a; Du et al., 2021). We empirically show that, while using the same denoising network, DPF effectively deals with different modalities like 2D images and 3D geometry, in addition to modeling distributions over fields defined on non-Euclidean metric spaces.


title: Ultra-high-speed high-resolution laser lithography for lithium niobate integrated photonics

abstract: Photolithography assisted chemo-mechanical etching (PLACE), a technique specifically developed for fabricating highquality large-scale photonic integrated circuits (PICs) on thin-film lithium niobate (TFLN), has enabled fabrication of a series of building blocks of PICs ranging from high-quality (high-Q) microresonators and low-loss waveguides to electrooptically (EO) tunable lasers and waveguide amplifiers. Aiming at high-throughput manufacturing of the PIC devices and systems, we have developed an ultra-high-speed high-resolution laser lithography fabrication system employing a high repetition rate femtosecond laser and a high-speed polygon laser scanner, by which a lithography fabrication efficiency of 4.8 cm2/h has been achieved at a spatial resolution of 200 nm. We demonstrate wafer-scale fabrication of TFLN-based photonic structures, optical phase masks as well as color printing


title: Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fields

abstract: 3D model reconstruction from a single image has achieved great progress with the recent deep generative models. However, the conventional reconstruction approaches with template mesh deformation and implicit fields have difficulty in reconstructing non-watertight 3D mesh models, such as garments. In contrast to image-based modeling, the sketch-based approach can help users generate 3D models to meet the design intentions from hand-drawn sketches. In this study, we propose Sketch2Cloth, a sketch-based 3D garment generation system using the unsigned distance fields from the user's sketch input. Sketch2Cloth first estimates the unsigned distance function of the target 3D model from the sketch input, and extracts the mesh from the estimated field with Marching Cubes. We also provide the model editing function to modify the generated mesh. We verified the proposed Sketch2Cloth with quantitative evaluations on garment generation and editing with a state-of-the-art approach.


title: REASONER: An Explainable Recommendation Dataset with Multi-aspect Real User Labeled Ground Truths Towards more Measurable Explainable Recommendation

abstract: Explainable recommendation has attracted much attention from the industry and academic communities. It has shown great potential for improving the recommendation persuasiveness, informativeness and user satisfaction. Despite a lot of promising explainable recommender models have been proposed in the past few years, the evaluation strategies of these models suffer from several limitations. For example, the explanation ground truths are not labeled by real users, the explanations are mostly evaluated based on only one aspect and the evaluation strategies can be hard to unify. To alleviate the above problems, we propose to build an explainable recommendation dataset with multi-aspect real user labeled ground truths. In specific, we firstly develop a video recommendation platform, where a series of questions around the recommendation explainability are carefully designed. Then, we recruit about 3000 users with different backgrounds to use the system, and collect their behaviors and feedback to our questions. In this paper, we detail the construction process of our dataset and also provide extensive analysis on its characteristics. In addition, we develop a library, where ten well-known explainable recommender models are implemented in a unified framework. Based on this library, we build several benchmarks for different explainable recommendation tasks. At last, we present many new opportunities brought by our dataset, which are expected to shed some new lights to the explainable recommendation field. Our dataset, library and the related documents have been released at https://reasoner2023.github.io/.


title: An Exploratory Study on the Usage and Readability of Messages Within Assertion Methods of Test Cases

abstract: Unit testing is a vital part of the software development process and involves developers writing code to verify or assert production code. Furthermore, to help comprehend the test case and troubleshoot issues, developers have the option to provide a message that explains the reason for the assertion failure. In this exploratory empirical study, we examine the characteristics of assertion messages contained in the test methods in 20 open-source Java systems. Our findings show that while developers rarely utilize the option of supplying a message, those who do, either compose it of only string literals, identifiers, or a combination of both types. Using standard English readability measuring techniques, we observe that a beginner's knowledge of English is required to understand messages containing only identifiers, while a 4th-grade education level is required to understand messages composed of string literals. We also discuss shortcomings with using such readability measuring techniques and common anti-patterns in assert message construction. We envision our results incorporated into code quality tools that appraise the understandability of assertion messages.


title: Asymmetric Learning for Graph Neural Network based Link Prediction

abstract: Link prediction is a fundamental problem in many graph based applications, such as protein-protein interaction prediction. Graph neural network (GNN) has recently been widely used for link prediction. However, existing GNN based link prediction (GNN-LP) methods suffer from scalability problem during training for large-scale graphs, which has received little attention by researchers. In this paper, we first give computation complexity analysis of existing GNN-LP methods, which reveals that the scalability problem stems from their symmetric learning strategy adopting the same class of GNN models to learn representation for both head and tail nodes. Then we propose a novel method, called asymmetric learning (AML), for GNN-LP. The main idea of AML is to adopt a GNN model for learning head node representation while using a multi-layer perceptron (MLP) model for learning tail node representation. Furthermore, AML proposes a row-wise sampling strategy to generate mini-batch for training, which is a necessary component to make the asymmetric learning strategy work for training speedup. To the best of our knowledge, AML is the first GNN-LP method adopting an asymmetric learning strategy for node representation learning. Experiments on three real large-scale datasets show that AML is 1.7X~7.3X faster in training than baselines with a symmetric learning strategy, while having almost no accuracy loss.


title: DTW-SiameseNet: Dynamic Time Warped Siamese Network for Mispronunciation Detection and Correction

abstract: Personal Digital Assistants (PDAs) - such as Siri, Alexa and Google Assistant, to name a few - play an increasingly important role to access information and complete tasks spanning multiple domains, and by diverse groups of users. A text-to-speech (TTS) module allows PDAs to interact in a natural, human-like manner, and play a vital role when the interaction involves people with visual impairments or other disabilities. To cater to the needs of a diverse set of users, inclusive TTS is important to recognize and pronounce correctly text in different languages and dialects. Despite great progress in speech synthesis, the pronunciation accuracy of named entities in a multi-lingual setting still has a large room for improvement. Existing approaches to correct named entity (NE) mispronunciations, like retraining Grapheme-to-Phoneme (G2P) models, or maintaining a TTS pronunciation dictionary, require expensive annotation of the ground truth pronunciation, which is also time consuming. In this work, we present a highly-precise, PDA-compatible pronunciation learning framework for the task of TTS mispronunciation detection and correction. In addition, we also propose a novel mispronunciation detection model called DTW-SiameseNet, which employs metric learning with a Siamese architecture for Dynamic Time Warping (DTW) with triplet loss. We demonstrate that a locale-agnostic, privacy-preserving solution to the problem of TTS mispronunciation detection is feasible. We evaluate our approach on a real-world dataset, and a corpus of NE pronunciations of an anonymized audio dataset of person names recorded by participants from 10 different locales. Human evaluation shows our proposed approach improves pronunciation accuracy on average by ~6% compared to strong phoneme-based and audio-based baselines.


title: Survivor-Centered Transformative Justice: An Approach to Designing Alongside Domestic Violence Stakeholders in US Muslim Communities

abstract: While domestic violence (DV) is prevalent in all socioeconomic settings, identity highly impacts how one experiences and recovers from abuse. This work examines US-based Muslim women's challenges when seeking help and healing from domestic violence. Through participatory interviews with 23 participants within the DV ecosystem, we find that victim-survivors' autonomy is compromised throughout the abuse, within their immediate communities, and when involving the criminal justice system. To address such harms, we adapt a survivor-centered transformative justice (SCTJ) approach, a framework to discern individual and systemic harm, to understand how to design alongside victim-survivors, and to focus on victim-survivors' autonomy. We explain under what conditions an SCTJ approach may be productive for designers. We use insights from our interviews to highlight intervention areas for reducing harm, repairing harm, and promoting healing for victim-survivors. Lastly, we offer guidelines to design for harm reduction, accountability, and systemic change.


title: BP-NTT: Fast and Compact in-SRAM Number Theoretic Transform with Bit-Parallel Modular Multiplication

abstract: Number Theoretic Transform (NTT) is an essential mathematical tool for computing polynomial multiplication in promising lattice-based cryptography. However, costly division operations and complex data dependencies make efficient and flexible hardware design to be challenging, especially on resource-constrained edge devices. Existing approaches either focus on only limited parameter settings or impose substantial hardware overhead. In this paper, we introduce a hardware-algorithm methodology to efficiently accelerate NTT in various settings using in-cache computing. By leveraging an optimized bit-parallel modular multiplication and introducing costless shift operations, our proposed solution provides up to 29x higher throughput-per-area and 2.8-100x better throughput-per-area-per-joule compared to the state-of-the-art.


title: Quantum autonomous Boolean networks

abstract: Boolean networks, first developed in the late 1960s as a tool for studying complex disordered dynamical systems, consist of nodes governed by Boolean functions whose evolution is entirely deterministic in that the state of the network at a given time fully determines the state of the network at some future time. They are known for exhibiting a high degree of spontaneous order and have since become a fundamental tool for modeling a wide variety of systems. In this article I develop a model for quantum autonomous Boolean networks that exhibits many of the same properties as the classical model while also demonstrating uniquely quantum properties within a rich landscape of behavior.


title: A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imaging

abstract: Harmonizing the analysis of data, especially of 3-D image volumes, consisting of different number of slices and annotated per volume, is a significant problem in training and using deep neural networks in various applications, including medical imaging. Moreover, unifying the decision making of the networks over different input datasets is crucial for the generation of rich data-driven knowledge and for trusted usage in the applications. This paper presents a new deep neural architecture, named RACNet, which includes routing and feature alignment steps and effectively handles different input lengths and single annotations of the 3-D image inputs, whilst providing highly accurate decisions. In addition, through latent variable extraction from the trained RACNet, a set of anchors are generated providing further insight on the network's decision making. These can be used to enrich and unify data-driven knowledge extracted from different datasets. An extensive experimental study illustrates the above developments, focusing on COVID-19 diagnosis through analysis of 3-D chest CT scans from databases generated in different countries and medical centers.


title: Zyxin is all you need: machine learning adherent cell mechanics

abstract: Cellular form and function emerge from complex mechanochemical systems within the cytoplasm. No systematic strategy currently exists to infer large-scale physical properties of a cell from its many molecular components. This is a significant obstacle to understanding biophysical processes such as cell adhesion and migration. Here, we develop a data-driven biophysical modeling approach to learn the mechanical behavior of adherent cells. We first train neural networks to predict forces generated by adherent cells from images of cytoskeletal proteins. Strikingly, experimental images of a single focal adhesion protein, such as zyxin, are sufficient to predict forces and generalize to unseen biological regimes. This protein field alone contains enough information to yield accurate predictions even if forces themselves are generated by many interacting proteins. We next develop two approaches - one explicitly constrained by physics, the other more agnostic - that help construct data-driven continuum models of cellular forces using this single focal adhesion field. Both strategies consistently reveal that cellular forces are encoded by two different length scales in adhesion protein distributions. Beyond adherent cell mechanics, our work serves as a case study for how to integrate neural networks in the construction of predictive phenomenological models in cell biology, even when little knowledge of the underlying microscopic mechanisms exist.


title: Finite-sample Guarantees for Nash Q-learning with Linear Function Approximation

abstract: Nash Q-learning may be considered one of the first and most known algorithms in multi-agent reinforcement learning (MARL) for learning policies that constitute a Nash equilibrium of an underlying general-sum Markov game. Its original proof provided asymptotic guarantees and was for the tabular case. Recently, finite-sample guarantees have been provided using more modern RL techniques for the tabular case. Our work analyzes Nash Q-learning using linear function approximation -- a representation regime introduced when the state space is large or continuous -- and provides finite-sample guarantees that indicate its sample efficiency. We find that the obtained performance nearly matches an existing efficient result for single-agent RL under the same representation and has a polynomial gap when compared to the best-known result for the tabular case.


title: Disentangling Structural Breaks in Factor Models for Macroeconomic Data

abstract: Through a routine normalization of the factor variance, standard methods for estimating factor models in macroeconomics do not distinguish between breaks of the factor variance and factor loadings. We argue that it is important to distinguish between structural breaks in the factor variance and loadings within factor models commonly employed in macroeconomics as both can lead to markedly different interpretations when viewed via the lens of the underlying dynamic factor model. We then develop a projection-based decomposition that leads to two standard and easy-to-implement Wald tests to disentangle structural breaks in the factor variance and factor loadings. Applying our procedure to U.S. macroeconomic data, we find evidence of both types of breaks associated with the Great Moderation and the Great Recession. Through our projection-based decomposition, we estimate that the Great Moderation is associated with an over 60% reduction in the total factor variance, highlighting the relevance of disentangling breaks in the factor structure.


title: A Unified Momentum-based Paradigm of Decentralized SGD for Non-Convex Models and Heterogeneous Data

abstract: Emerging distributed applications recently boosted the development of decentralized machine learning, especially in IoT and edge computing fields. In real-world scenarios, the common problems of non-convexity and data heterogeneity result in inefficiency, performance degradation, and development stagnation. The bulk of studies concentrates on one of the issues mentioned above without having a more general framework that has been proven optimal. To this end, we propose a unified paradigm called UMP, which comprises two algorithms, D-SUM and GT-DSUM, based on the momentum technique with decentralized stochastic gradient descent(SGD). The former provides a convergence guarantee for general non-convex objectives. At the same time, the latter is extended by introducing gradient tracking, which estimates the global optimization direction to mitigate data heterogeneity(i.e., distribution drift). We can cover most momentum-based variants based on the classical heavy ball or Nesterov's acceleration with different parameters in UMP. In theory, we rigorously provide the convergence analysis of these two approaches for non-convex objectives and conduct extensive experiments, demonstrating a significant improvement in model accuracy by up to 57.6% compared to other methods in practice.


title: FaceRNET: a Facial Expression Intensity Estimation Network

abstract: This paper presents our approach for Facial Expression Intensity Estimation from videos. It includes two components: i) a representation extractor network that extracts various emotion descriptors (valence-arousal, action units and basic expressions) from each videoframe; ii) a RNN that captures temporal information in the data, followed by a mask layer which enables handling varying input video lengths through dynamic routing. This approach has been tested on the Hume-Reaction dataset yielding excellent results.


title: Selectively Hard Negative Mining for Alleviating Gradient Vanishing in Image-Text Matching

abstract: Recently, a series of Image-Text Matching (ITM) methods achieve impressive performance. However, we observe that most existing ITM models suffer from gradients vanishing at the beginning of training, which makes these models prone to falling into local minima. Most ITM models adopt triplet loss with Hard Negative mining (HN) as the optimization objective. We find that optimizing an ITM model using only the hard negative samples can easily lead to gradient vanishing. In this paper, we derive the condition under which the gradient vanishes during training. When the difference between the positive pair similarity and the negative pair similarity is close to 0, the gradients on both the image and text encoders will approach 0. To alleviate the gradient vanishing problem, we propose a Selectively Hard Negative Mining (SelHN) strategy, which chooses whether to mine hard negative samples according to the gradient vanishing condition. SelHN can be plug-and-play applied to existing ITM models to give them better training behavior. To further ensure the back-propagation of gradients, we construct a Residual Visual Semantic Embedding model with SelHN, denoted as RVSE++. Extensive experiments on two ITM benchmarks demonstrate the strength of RVSE++, achieving state-of-the-art performance.


title: A Probabilistic Reformulation Technique for Discrete RIS Optimization in Wireless Systems

abstract: The use of reconfigurable intelligent surfaces (RIS) can improve wireless communication by modifying the wireless link to create virtual line-of-sight links, bypass blockages, suppress interference, and enhance localization. However, enabling the RIS to modify the wireless channel requires careful optimization of the RIS phase-shifts. Although discrete RIS is more practical given hardware limitations, continuous RIS phase-shift optimization has attracted significantly more attention than discrete RIS optimization, which suffers from issues like quantization error and scalability. We develop a comprehensive probabilistic technique to transform discrete optimization problems into optimization problems of continuous domain probability parameters by interpreting the discrete optimization variable as a categorical random vector and computing expectations with respect to those parameters. We rigorously establish that for the unconstrained case, the optimal points of the reformulation and the original problem coincide. For the constrained case, we prove that the transformed problem is a relaxation of the original problem. We apply the proposed technique to two canonical discrete RIS applications: SINR maximization and overhead-aware rate and energy efficiency (EE) maximization. The reformulation enables both stochastic and analytical interpretations of the original problems. The former interpretation yields a stochastic sampling technique, whereas the latter yields an analytical gradient descent (GD) approach that employs closed-form approximations for the expectation. The numerical results demonstrate that the proposed technique is applicable to a variety of discrete RIS optimization problems and outperforms other general approaches, such as closest point projection (CPP) and semidefinite relaxation (SDR) methods.


title: Pulsars as candidates of LHAASO sources J2226+6057, J1908+0621 and J1825-1326: The leptonic origin

abstract: Recently, from 12 $\gamma$-ray Galactic sources, the LHAASO has detected ultrahigh-energy photons up to 1.4PeV. The $\gamma$-ray spectra of the sources J2226+6057, J1908+0621, J1825-1326 and the suggested origin pulsars near the sources have been published. In our previous work, we studied the hadronic $\gamma$-ray spectra of the sources J2226+6057, J1908+0621, J1825-1326 in terms of the Hertzian dipole model of pulsar. In this paper, we investigate the possibility of the leptonic origin of the $\gamma$-ray. We use the Hertzian dipole model to describe the pulsars around the sources. The electrons around the pulsars can be accelerated to PeV by the electromagnetic fields of pulsars. Under the assumption that the initial electrons are uniform distributed in a spherical shell between $10^{7}$ to $10^{9}$m around the pulsar, we obtain the energy distribution of electrons. The leptonic $\gamma$-ray spectra can be calculated through inverse Compton scattering processes. The leptonic $\gamma$-ray can roughly conform to the observation of LHAASO.


title: Parametric Amplifier Matching Using Legendre Prototypes

abstract: In this note we describe Josephson parametric amplifier (JPA) matching networks based on Legendre polynomials. These networks typically exhibit lower ripple and gentler roll-off than Chebyshev networks with similar parameters, and can be viewed as bridging the gap between Butterworth and Chebyshev ones. We tabulate prototype coefficients for parametric amplifiers based on Legendre polynomials with a range of gain and ripple parameters, and for a range of network orders. We also use this opportunity to further illustrate the synthesis of these networks based on methods from previous work, and synthesize a prototype JPA with 20dB gain at a center frequency of 5GHz with a bandwidth of 500MHz.


title: Rashba spin-orbit coupling enhanced magnetoresistance in junctions with one ferromagnet

abstract: We explain how Rashba spin-orbit coupling (SOC) in a two-dimensional electron gas (2DEG), or in a conventional $s$-wave superconductor, can lead to a large magnetoresistance even with one ferromagnet. However, such enhanced magnetoresistance is not generic and can be nonmonotonic and change its sign with Rashba SOC. For an in-plane rotation of magnetization, it is typically negligibly small for a 2DEG and depends on the perfect transmission which emerges from a spin-parity-time symmetry of the scattering states, while this symmetry is generally absent from the Hamiltonian of the system. The key difference from considering the normal-state magnetoresistance is the presence of the spin-dependent Andreev reflection at superconducting interfaces. In the fabricated junctions of quasi-2D van der Waals ferromagnets with conventional $s$-wave superconductors (Fe$_{0.29}$TaS$_2$/NbN) we find another example of enhanced magnetoresistance where the presence of Rashba SOC reduces the effective interfacial strength and is responsible for an equal-spin Andreev reflection. The observed nonmonotonic trend in the out-of-plane magnetoresistance with the interfacial barrier is an evidence for the proximity-induced equal-spin-triplet superconductivity.


title: Targeted demand response for flexible energy communities using clustering techniques

abstract: The present study proposes clustering techniques for designing demand response (DR) programs for commercial and residential prosumers. The goal is to alter the consumption behavior of the prosumers within a distributed energy community in Italy. This aggregation aims to: a) minimize the reverse power flow at the primary substation, occuring when generation from solar panels in the local grid exceeds consumption, and b) shift the system wide peak demand, that typically occurs during late afternoon. Regarding the clustering stage, we consider daily prosumer load profiles and divide them across the extracted clusters. Three popular machine learning algorithms are employed, namely k-means, k-medoids and agglomerative clustering. We evaluate the methods using multiple metrics including a novel metric proposed within this study, namely peak performance score (PPS). The k-means algorithm with dynamic time warping distance considering 14 clusters exhibits the highest performance with a PPS of 0.689. Subsequently, we analyze each extracted cluster with respect to load shape, entropy, and load types. These characteristics are used to distinguish the clusters that have the potential to serve the optimization objectives by matching them to proper DR schemes including time of use, critical peak pricing, and real-time pricing. Our results confirm the effectiveness of the proposed clustering algorithm in generating meaningful flexibility clusters, while the derived DR pricing policy encourages consumption during off-peak hours. The developed methodology is robust to the low availability and quality of training datasets and can be used by aggregator companies for segmenting energy communities and developing personalized DR policies.


title: On the Integration of Physics-Based Machine Learning with Hierarchical Bayesian Modeling Techniques

abstract: Machine Learning (ML) has widely been used for modeling and predicting physical systems. These techniques offer high expressive power and good generalizability for interpolation within observed data sets. However, the disadvantage of black-box models is that they underperform under blind conditions since no physical knowledge is incorporated. Physics-based ML aims to address this problem by retaining the mathematical flexibility of ML techniques while incorporating physics. In accord, this paper proposes to embed mechanics-based models into the mean function of a Gaussian Process (GP) model and characterize potential discrepancies through kernel machines. A specific class of kernel function is promoted, which has a connection with the gradient of the physics-based model with respect to the input and parameters and shares similarity with the exact Autocovariance function of linear dynamical systems. The spectral properties of the kernel function enable considering dominant periodic processes originating from physics misspecification. Nevertheless, the stationarity of the kernel function is a difficult hurdle in the sequential processing of long data sets, resolved through hierarchical Bayesian techniques. This implementation is also advantageous to mitigate computational costs, alleviating the scalability of GPs when dealing with sequential data. Using numerical and experimental examples, potential applications of the proposed method to structural dynamics inverse problems are demonstrated.


title: On the Capacity Region of Optical Intensity Broadcast Channels

abstract: This paper investigates the capacity region of the optical intensity broadcast channels (OI-BCs), where the input is subject to a peak-intensity constraint, an average-intensity constraint, or both. By leveraging the decomposition results of several random variables, i.e., uniform, exponential, and truncated exponential random variables, and adopting a superposition coding (SC) scheme, the inner bound on the capacity region is derived. Then, the outer bound is derived by applying the conditional entropy power inequality (EPI). In the high signal-to-noise ratio (SNR) regime, the inner bound asymptotically matches the outer bound, thus characterizing the high-SNR asymptotic capacity region. The bounds are also extended to the general K-user BCs without loss of high-SNR asymptotic optimality.


title: Quantum PT-Phase Diagram in a Non-Hermitian Photonic Structure

abstract: Photonic structures have an inherent advantage to realize PT-phase transition through modulating the refractive index or gain-loss. However, quantum PT properties of these photonic systems have not been comprehensively studied yet. Here, in a bi-photonic structure with loss and gain simultaneously existing, we analytically obtained the quantum PT-phase diagram under the steady state condition. To characterize the PT-symmetry or -broken phase, we define an Hermitian exchange operator expressing the exchange between quadrature variables of two modes. If inputting several-photon Fock states into a PT-broken bi-waveguide splitting system, most photons will concentrate in the dominant waveguide with some state distributions. Quantum PT-phase diagram paves the way to the quantum state engineering, quantum interferences, and logic operations in non-Hermitian photonic systems.


title: Gravitational lensing by a charged spherically symmetric black hole immersed in thin dark matter

abstract: We investigate the gravitational lensing effect around a spherically symmetric black hole, whose metric is obtained from the Einstein field equation with electric charge and perfect-fluid dark matter contributing to its energy-momentum tensor. We do the calculation analytically in the weak field limit and we assume that both the charge and the dark matter are much less abundant (only give rise to the next-leading-order contribution) in comparison to the black hole mass. In particular, we derive the light deflection angle and the size of the Einstein ring, where approximations up to the next-leading order are done with extra care, especially for the logarithmic term from perfect-fluid dark matter. We expect our results will be useful in the future to relate the theoretical model of perfect fluid dark matter with observations of celestial bodies immersed in thin dark matter.


title: pyribs: A Bare-Bones Python Library for Quality Diversity Optimization

abstract: Recent years have seen a rise in the popularity of quality diversity (QD) optimization, a branch of optimization that seeks to find a collection of diverse, high-performing solutions to a given problem. To grow further, we believe the QD community faces two challenges: developing a framework to represent the field's growing array of algorithms, and implementing that framework in software that supports a range of researchers and practitioners. To address these challenges, we have developed pyribs, a library built on a highly modular conceptual QD framework. By replacing components in the conceptual framework, and hence in pyribs, users can compose algorithms from across the QD literature; equally important, they can identify unexplored algorithm variations. Furthermore, pyribs makes this framework simple, flexible, and accessible, with a user-friendly API supported by extensive documentation and tutorials. This paper overviews the creation of pyribs, focusing on the conceptual framework that it implements and the design principles that have guided the library's development.


title: Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools

abstract: AI-based design tools are proliferating in professional software to assist engineering and industrial designers in complex manufacturing and design tasks. These tools take on more agentic roles than traditional computer-aided design tools and are often portrayed as "co-creators." Yet, working effectively with such systems requires different skills than working with complex CAD tools alone. To date, we know little about how engineering designers learn to work with AI-based design tools. In this study, we observed trained designers as they learned to work with two AI-based tools on a realistic design task. We find that designers face many challenges in learning to effectively co-create with current systems, including challenges in understanding and adjusting AI outputs and in communicating their design goals. Based on our findings, we highlight several design opportunities to better support designer-AI co-creation.


title: CLIPER: A Unified Vision-Language Framework for In-the-Wild Facial Expression Recognition

abstract: Facial expression recognition (FER) is an essential task for understanding human behaviors. As one of the most informative behaviors of humans, facial expressions are often compound and variable, which is manifested by the fact that different people may express the same expression in very different ways. However, most FER methods still use one-hot or soft labels as the supervision, which lack sufficient semantic descriptions of facial expressions and are less interpretable. Recently, contrastive vision-language pre-training (VLP) models (e.g., CLIP) use text as supervision and have injected new vitality into various computer vision tasks, benefiting from the rich semantics in text. Therefore, in this work, we propose CLIPER, a unified framework for both static and dynamic facial Expression Recognition based on CLIP. Besides, we introduce multiple expression text descriptors (METD) to learn fine-grained expression representations that make CLIPER more interpretable. We conduct extensive experiments on several popular FER benchmarks and achieve state-of-the-art performance, which demonstrates the effectiveness of CLIPER.


title: The Ionization and Dynamics of the Makani Galactic Wind

abstract: The Makani galaxy hosts the poster child of a galactic wind on scales of the circumgalactic medium. It consists of a two-episode wind in which the slow, outer wind originated 400 Myr ago (Episode I; R_I = 20-50 kpc) and the fast, inner wind is 7 Myr old (Episode II; R_II = 0-20 kpc). While this wind contains ionized, neutral, and molecular gas, the physical state and mass of the most extended phase--the warm, ionized gas--is unknown. Here we present Keck optical spectra of the Makani outflow. These allow us to detect hydrogen lines out to r = 30-40 kpc and thus constrain the mass, momentum, and energy in the wind. Many collisionally-excited lines are detected throughout the wind, and their line ratios are consistent with 200-400 km/s shocks that power the ionized gas, with v_shock = $\sigma$_wind. Combining shock models, density-sensitive line ratios, and mass and velocity measurements, we estimate that the ionized mass and outflow rate in the Episode II wind could be as high as that of the molecular gas: M_II(HII) ~ M_II(H_2) = (1-2)x10^9 Msun and dM/dt_II(HII) ~ dM/dt_II(H_2) = 170-250 Msun/yr. The outer wind has slowed, so that dM/dt_I(HII) ~ 10 Msun/yr, but it contains more ionized gas: M_I(HII) = 5x10^9 Msun. The momentum and energy in the recent Episode II wind imply a momentum-driven flow (p ``boost" ~ 7) driven by the hot ejecta and radiation pressure from the Eddington-limited, compact starburst. Much of the energy and momentum in the older Episode I wind may reside in a hotter phase, or lie further into the CGM.


title: Jeffery's orbits and microswimmers in flows: A theoretical review

abstract: In this review, we provide a theoretical introduction to Jeffery's equations for the orientation dynamics of an axisymmetric object in a flow at low Reynolds number, and review recent theoretical extensions and applications to the motions of self-propelled particles, so-called microswimmers, in external flows. Bacteria colonize human organs and medical devices even with flowing fluid, microalgae occasionally cause huge harmful toxic blooms in lakes and oceans, and recent artificial microrobots can migrate in flows generated in well-designed microfluidic chambers. The Jeffery equations, a simple set of ordinary differential equation, provide a useful building block in modeling, analyzing, and understanding these microswimmer dynamics in a flow current, in particular when incorporating the impact of the swimmer shape since the equations contain a shape parameter as a single scalar, known as the Bretherton parameter. The particle orientation forms a closed orbit when situated in a simple shear, and this non-uniform periodic rotational motion, referred to as Jeffery's orbits, is due to a constant of motion in the non-linear equation. After providing a theoretical introduction to microswimmer hydrodynamics and a derivation of the Jeffery equations, we discuss possible extensions to more general shapes, including those with rapid deformation. In the latter part of this review, simple mathematical models of microswimmers in different types of flow fields are described, with a focus on constants of motion and their relation to periodic motions in phase space, together with a breakdown of degenerate orbits, to discuss the stable, unstable, and chaotic dynamics of the system. The discussion in this paper will provide a comprehensive theoretical foundation for Jeffery's orbits and will be useful to understand the motions of microswimmers under various flows.


title: Transformed Low-Rank Parameterization Can Help Robust Generalization for Tensor Neural Networks

abstract: Achieving efficient and robust multi-channel data learning is a challenging task in data science. By exploiting low-rankness in the transformed domain, i.e., transformed low-rankness, tensor Singular Value Decomposition (t-SVD) has achieved extensive success in multi-channel data representation and has recently been extended to function representation such as Neural Networks with t-product layers (t-NNs). However, it still remains unclear how t-SVD theoretically affects the learning behavior of t-NNs. This paper is the first to answer this question by deriving the upper bounds of the generalization error of both standard and adversarially trained t-NNs. It reveals that the t-NNs compressed by exact transformed low-rank parameterization can achieve a sharper adversarial generalization bound. In practice, although t-NNs rarely have exactly transformed low-rank weights, our analysis further shows that by adversarial training with gradient flow (GF), the over-parameterized t-NNs with ReLU activations are trained with implicit regularization towards transformed low-rank parameterization under certain conditions. We also establish adversarial generalization bounds for t-NNs with approximately transformed low-rank weights. Our analysis indicates that the transformed low-rank parameterization can promisingly enhance robust generalization for t-NNs.


title: Development and task-based evaluation of a scatter-window projection and deep learning-based transmission-less attenuation compensation method for myocardial perfusion SPECT

abstract: Attenuation compensation (AC) is beneficial for visual interpretation tasks in single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI). However, traditional AC methods require the availability of a transmission scan, most often a CT scan. This approach has the disadvantages of increased radiation dose, increased scanner cost, and the possibility of inaccurate diagnosis in cases of misregistration between the SPECT and CT images. Further, many SPECT systems do not include a CT component. To address these issues, we developed a Scatter-window projection and deep Learning-based AC (SLAC) method to perform AC without a separate transmission scan. To investigate the clinical efficacy of this method, we then objectively evaluated the performance of this method on the clinical task of detecting perfusion defects on MPI in a retrospective study with anonymized clinical SPECT/CT stress MPI images. The proposed method was compared with CT-based AC (CTAC) and no-AC (NAC) methods. Our results showed that the SLAC method yielded an almost overlapping receiver operating characteristic (ROC) plot and a similar area under the ROC (AUC) to the CTAC method on this task. These results demonstrate the capability of the SLAC method for transmission-less AC in SPECT and motivate further clinical evaluation.


title: Convolutional Visual Prompt for Robust Visual Perception

abstract: Vision models are often vulnerable to out-of-distribution (OOD) samples without adapting. While visual prompts offer a lightweight method of input-space adaptation for large-scale vision models, they rely on a high-dimensional additive vector and labeled data. This leads to overfitting when adapting models in a self-supervised test-time setting without labels. We introduce convolutional visual prompts (CVP) for label-free test-time adaptation for robust visual perception. The structured nature of CVP demands fewer trainable parameters, less than 1\% compared to standard visual prompts, combating overfitting. Extensive experiments and analysis on a wide variety of OOD visual perception tasks show that our approach is effective, improving robustness by up to 5.87% over several large-scale models.