title: Multimodal Instruction Tuning with Conditional Mixture of LoRA

abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in diverse tasks across different domains, with an increasing focus on improving their zero-shot generalization capabilities for unseen multimodal tasks. Multimodal instruction tuning has emerged as a successful strategy for achieving zero-shot generalization by fine-tuning pre-trained models on diverse multimodal tasks through instructions. As MLLMs grow in complexity and size, the need for parameter-efficient fine-tuning methods like Low-Rank Adaption (LoRA), which fine-tunes with a minimal set of parameters, becomes essential. However, applying LoRA in multimodal instruction tuning presents the challenge of task interference, which leads to performance degradation, especially when dealing with a broad array of multimodal tasks. To address this, this paper introduces a novel approach that integrates multimodal instruction tuning with Conditional Mixture-of-LoRA (MixLoRA). It innovates upon LoRA by dynamically constructing low-rank adaptation matrices tailored to the unique demands of each input instance, aiming to mitigate task interference. Experimental results on various multimodal evaluation datasets indicate that MixLoRA not only outperforms the conventional LoRA with the same or even higher ranks, demonstrating its efficacy and adaptability in diverse multimodal tasks.


title: MMW-Carry: Enhancing Carry Object Detection through Millimeter-Wave Radar-Camera Fusion

abstract: This paper introduces MMW-Carry, a system designed to predict the probability of individuals carrying various objects using millimeter-wave radar signals, complemented by camera input. The primary goal of MMW-Carry is to provide a rapid and cost-effective preliminary screening solution, specifically tailored for non-super-sensitive scenarios. Overall, MMW-Carry achieves significant advancements in two crucial aspects. Firstly, it addresses localization challenges in complex indoor environments caused by multi-path reflections, enhancing the system's overall robustness. This is accomplished by the integration of camera-based human detection, tracking, and the radar-camera plane transformation for obtaining subjects' spatial occupancy region, followed by a zooming-in operation on the radar images. Secondly, the system performance is elevated by leveraging long-term observation of a subject. This is realized through the intelligent fusion of neural network results from multiple different-view radar images of an in-track moving subject and their carried objects, facilitated by a proposed knowledge-transfer module. Our experiment results demonstrate that MMW-Carry detects objects with an average error rate of 25.22\% false positives and a 21.71\% missing rate for individuals moving randomly in a large indoor space, carrying the common-in-everyday-life objects, both in open carry or concealed ways. These findings affirm MMW-Carry's potential to extend its capabilities to detect a broader range of objects for diverse applications.


title: Transductive Active Learning: Theory and Applications

abstract: We generalize active learning to address real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside this region. We analyze a family of decision rules that sample adaptively to minimize uncertainty about prediction targets. We are the first to show, under general regularity assumptions, that such decision rules converge uniformly to the smallest possible uncertainty obtainable from the accessible data. We demonstrate their strong sample efficiency in two key applications: Active few-shot fine-tuning of large neural networks and safe Bayesian optimization, where they improve significantly upon the state-of-the-art.


title: Borel Families of Games

abstract: We give an elementary proof that in a Borel family of games, the set of games for which player II has a winning strategy is Baire measurable, universally measurable, and completely Ramsey in the case where $X = [\mathbb{N}]^{\aleph_0}$.


title: Dedicated Restricted Target Wake Time for Real-Time Applications in Wi-Fi 7

abstract: Real-time applications (RTA) tend to play a crucial role in people's everyday life. Such applications are among the key use cases for the next generations of wireless technologies. RTA applications are characterized by strict guaranteed delay requirements (in the order of a few milliseconds). One of the pillars of enabling RTA in next-generation Wi-Fi standards is Restricted Target Wake Time (R-TWT), which provides Wi-Fi stations exclusive channel access within negotiated service periods (SPs). If each RTA data flow uses dedicated SPs for data transmission, they are completely isolated from each other and do not experience any contention. To ensure the satisfaction of RTA QoS requirements while minimizing the channel airtime consumption, it is important to properly select the R-TWT parameters, namely the duration of SPs and the period between SPs. In this paper, we develop a mathematical model that estimates the delay probability distribution and packet loss probability for a given set of network, traffic and R-TWT parameters. Using this model, the access point can select the optimal R-TWT parameters for the given QoS requirements. The high accuracy of the model is proven by means of simulation.


title: Ab initio description of monopole resonances in light- and medium-mass nuclei: II. Ab initio PGCM calculations in $^{46}$Ti, $^{28}$Si and $^{24}$Mg

abstract: Giant resonances (GRs) are a striking manifestation of collective motions in atomic nuclei. The present paper is the second in a series of four dedicated to the use of the projected generator coordinate method (PGCM) for the ab initio determination of the isoscalar giant monopole resonance (GMR) in closed- and open-shell mid-mass nuclei. While the first paper was dedicated to quantifying various uncertainty sources, the present paper focuses on the first applications to three doubly-open shell nuclei, namely $^{46}$Ti, $^{28}$Si and $^{24}$Mg. In particular, the goal is to investigate from an ab initio standpoint (i) the coupling of the GMR with the giant quadrupole resonance (GQR) in intrinsically-deformed nuclei, (ii) the possible impact of shape coexistence and shape mixing on the GMR, (iii) the GMR based on shape isomers and (iv) the impact of anharmonic effects on the monopole response. The latter is studied by comparing PGCM results to those obtained via the quasi-particle random phase approximation (QRPA), the traditional many-body approach to giant resonances, performed in a consistent setting. Eventually, PGCM results for sd-shell nuclei are in excellent agreement with experimental data, which is attributed to the capacity of the PGCM to capture the important fragmentation of the monopole response in light, intrinsically-deformed systems. Still, the comparison to data in $^{28}$Si and $^{24}$Mg illustrates the challenge (and the potential benefit) of extracting unambiguous experimental information.


title: Tight Frames Generated By A Graph Short-Time Fourier Transform

abstract: A graph short-time Fourier transform is defined using the eigenvectors of the graph Laplacian and a graph heat kernel as a window parametrized by a non-negative time parameter $t$. We show that the corresponding Gabor-like system forms a frame for $\mathbb{C}^d$ and give a description of the spectrum of the corresponding frame operator in terms of the graph heat kernel and the spectrum of the underlying graph Laplacian. For two classes of algebraic graphs, we prove the frame is tight and independent of the window parameter $t$.


title: ESFL: Efficient Split Federated Learning over Resource-Constrained Heterogeneous Wireless Devices

abstract: Federated learning (FL) allows multiple parties (distributed devices) to train a machine learning model without sharing raw data. How to effectively and efficiently utilize the resources on devices and the central server is a highly interesting yet challenging problem. In this paper, we propose an efficient split federated learning algorithm (ESFL) to take full advantage of the powerful computing capabilities at a central server under a split federated learning framework with heterogeneous end devices (EDs). By splitting the model into different submodels between the server and EDs, our approach jointly optimizes user-side workload and server-side computing resource allocation by considering users' heterogeneity. We formulate the whole optimization problem as a mixed-integer non-linear program, which is an NP-hard problem, and develop an iterative approach to obtain an approximate solution efficiently. Extensive simulations have been conducted to validate the significantly increased efficiency of our ESFL approach compared with standard federated learning, split learning, and splitfed learning.


title: Optimal Budget Aggregation with Single-Peaked Preferences

abstract: We study the problem of aggregating distributions, such as budget proposals, into a collective distribution. An ideal aggregation mechanism would be Pareto efficient, strategyproof, and fair. Most previous work assumes that agents evaluate budgets according to the $\ell_1$ distance to their ideal budget. We investigate and compare different models from the larger class of star-shaped utility functions - a multi-dimensional generalization of single-peaked preferences. For the case of two alternatives, we extend existing results by proving that under very general assumptions, the uniform phantom mechanism is the only strategyproof mechanism that satisfies proportionality - a minimal notion of fairness introduced by Freeman et al. (2021). Moving to the case of more than two alternatives, we establish sweeping impossibilities for $\ell_1$ and $\ell_\infty$ disutilities: no mechanism satisfies efficiency, strategyproofness, and proportionality. We then propose a new kind of star-shaped utilities based on evaluating budgets by the ratios of shares between a given budget and an ideal budget. For these utilities, efficiency, strategyproofness, and fairness become compatible. In particular, we prove that the mechanism that maximizes the Nash product of individual utilities is characterized by group-strategyproofness and a core-based fairness condition.


title: Explainable Contrastive and Cost-Sensitive Learning for Cervical Cancer Classification

abstract: This paper proposes an efficient system for classifying cervical cancer cells using pre-trained convolutional neural networks (CNNs). We first fine-tune five pre-trained CNNs and minimize the overall cost of misclassification by prioritizing accuracy for certain classes that have higher associated costs or importance. To further enhance the performance of the models, supervised contrastive learning is included to make the models more adept at capturing important features and patterns. Extensive experimentation are conducted to evaluate the proposed system on the SIPaKMeD dataset. The experimental results demonstrate the effectiveness of the developed system, achieving an accuracy of 97.29%. To make our system more trustworthy, we have employed several explainable AI techniques to interpret how the models reached a specific decision. The implementation of the system can be found at - https://github.com/isha-67/CervicalCancerStudy.


title: Motivic Toda brackets

abstract: We construct Toda brackets in unstable motivic homotopy theory and prove some fundamental properties of them. Furthermore we construct some examples of motivic Toda brackets.


title: Investigating the basis set convergence of diagrammatically decomposed coupled-cluster correlation energy contributions for the uniform electron gas

abstract: We investigate the convergence of coupled-cluster correlation energies and related quantities with respect to the employed basis set size for the uniform electron gas to gain a better understanding of the basis set incompleteness error. To this end, coupled-cluster doubles (CCD) theory is applied to the three dimensional uniform electron gas for a range of densities, basis set sizes and electron numbers. We present a detailed analysis of individual, diagrammatically decomposed contributions to the amplitudes at the level of CCD theory. In particular, we show that only two terms from the amplitude equations contribute to the asymptotic large-momentum behavior of the transition structure factor, corresponding to the cusp region at short interelectronic distances. However, due to the coupling present in the amplitude equations, all decomposed correlation energy contributions show the same asymptotic convergence behavior to the complete basis set limit. These findings provide an additional rationale for the success of a recently proposed correction to the basis set incompleteness error (BSIE) of coupled-cluster theory. Lastly, we examine the BSIE in the coupled-cluster doubles plus perturbative triples [CCD(T)] method, as well as in the newly proposed coupled-cluster doubles plus complete perturbative triples [CCD(cT)] method.


title: On the finiteness of $k$-vertex-critical $2P_2$-free graphs with forbidden induced squids or bulls

abstract: A graph is $k$-vertex-critical if $\chi(G)=k$ but $\chi(G-v)<k$ for all $v\in V(G)$ and $(G,H)$-free if it contains no induced subgraph isomorphic to $G$ or $H$. We show that there are only finitely many $k$-vertex-critical $(2P_2,H)$-free graphs for all $k$ when $H$ is isomorphic to any of the following graphs of order $5$: $bull$, $chair$, $claw+P_1$, or $\overline{diamond+P_1}$. The latter three are corollaries of more general results where $H$ is isomorphic to $(m, \ell)$-$squid$ for $m=3,4$ and any $\ell\ge 1$ where an $(m,\ell)$-$squid$ is the graph obtained from an $m$-cycle by attaching $\ell$ leaves to a single vertex of the cycle. For each of the graphs $H$ above and any fixed $k$, our results imply the existence of polynomial-time certifying algorithms for deciding the $k$-colourability problem for $(2P_2,H)$-free graphs. Further, our structural classifications allow us to exhaustively generate, with aid of computer search, all $k$-vertex-critical $(2P_2,H)$-free graphs for $k\le 7$ when $H=bull$ or $H=(4,1)$-$squid$ (also known as $banner$).


title: Enhanced Droplet Analysis Using Generative Adversarial Networks

abstract: Precision devices play an important role in enhancing production quality and productivity in agricultural systems. Therefore, the optimization of these devices is essential in precision agriculture. Recently, with the advancements of deep learning, there have been several studies aiming to harness its capabilities for improving spray system performance. However, the effectiveness of these methods heavily depends on the size of the training dataset, which is expensive and time-consuming to collect. To address the challenge of insufficient training samples, we developed an image generator named DropletGAN to generate images of droplets. The DropletGAN model is trained by using a small dataset captured by a high-speed camera and capable of generating images with progressively increasing resolution. The results demonstrate that the model can generate high-quality images with the size of 1024x1024. The generated images from the DropletGAN are evaluated using the Fr\'echet inception distance (FID) with an FID score of 11.29. Furthermore, this research leverages recent advancements in computer vision and deep learning to develop a light droplet detector using the synthetic dataset. As a result, the detection model achieves a 16.06% increase in mean average precision (mAP) when utilizing the synthetic dataset. To the best of our knowledge, this work stands as the first to employ a generative model for augmenting droplet detection. Its significance lies not only in optimizing nozzle design for constructing efficient spray systems but also in addressing the common challenge of insufficient data in various precision agriculture tasks. This work offers a critical contribution to conserving resources while striving for optimal and sustainable agricultural practices.


title: Energy landscape of noncollinear exchange coupled magnetic multilayers

abstract: We conduct an exploration of the energy landscape of two coupled ferromagnetic layers with perpendicular-to-plane uniaxial anisotropy using finite-element micromagnetic simulations. These multilayers can be used to produce noncollinearity in spin-transfer torque magnetic random-access memory cells, which has been shown to increase the performance of this class of computer memory. We show that there exists a range of values of the interlayer exchange coupling constants for which the magnetic state of these multilayers can relax into two energy minima. The size of this region is determined by the difference in the magnitude of the layer anisotropies and is minimized when this difference is large. In this case, there is a wide range of experimentally achievable coupling constants that can produce desirable and stable noncollinear alignment. We investigate the energy barriers separating the local and global minima using string method simulations, showing that the stabilities of the minima increase with increasing difference in the anisotropy of the ferromagnetic layers. We provide an analytical solution to the location of the minima in the energy landscape of coupled macrospins, which has good agreement with our micromagnetic results for a case involving ferromagnetic layers with the same thickness and anisotropy, no demagnetization field, and large exchange stiffness. These results are important to understand how best to employ noncollinear coupling in the next generation of thin film magnetic devices.


title: PRP: Propagating Universal Perturbations to Attack Large Language Model Guard-Rails

abstract: Large language models (LLMs) are typically aligned to be harmless to humans. Unfortunately, recent work has shown that such models are susceptible to automated jailbreak attacks that induce them to generate harmful content. More recent LLMs often incorporate an additional layer of defense, a Guard Model, which is a second LLM that is designed to check and moderate the output response of the primary LLM. Our key contribution is to show a novel attack strategy, PRP, that is successful against several open-source (e.g., Llama 2) and closed-source (e.g., GPT 3.5) implementations of Guard Models. PRP leverages a two step prefix-based attack that operates by (a) constructing a universal adversarial prefix for the Guard Model, and (b) propagating this prefix to the response. We find that this procedure is effective across multiple threat models, including ones in which the adversary has no access to the Guard Model at all. Our work suggests that further advances are required on defenses and Guard Models before they can be considered effective.


title: Role of quantum correlations in daemonic expected utility

abstract: Fluctuations can challenge the possibility of improving work extraction from quantum correlations. This uncertainty in the work extraction process can be addressed resorting to the expected utility hypothesis which can provide an optimal method for work extraction. We study a bipartite quantum system and examine the role of quantum correlations in a daemonic work extraction performed by certain local operations and classical communication. Specifically, we demonstrate and explain how, depending on the so-called absolute risk aversion, a non-neutral risk agent, influenced by fluctuations, views quantum correlations differently from a neutral risk agent who is affected solely by the average work.


title: Black holes thermodynamics with CFT re-scaling

abstract: In this paper, we study the thermodynamic behavior of charged AdS black holes in a conformal holographic extended thermodynamic. Our setup is constructed using a new dictionary that relates AdS black hole quantities to the corresponding dual conformal field theory (CFT) one, with the conformal factor being treated as a variable thermodynamic. In this thermodynamic study, we investigate the critical phenomena of charged AdS black holes and their relationship to the central charge value, \(C\). Additionally, we examine the phase transitions and black hole stability using the free energy and the heat capacity, respectively. Furthermore, by examining the chemical potential, we establish criteria that differentiate between quantum and classical black hole behaviors. Our setup highlights one of the key findings, namely traditional black hole thermodynamics acts as a boundary between quantum and classical regimes.


title: Cyclic branched covers of Seifert links and properties related to the $ADE$ link conjecture

abstract: In this article we show that all cyclic branched covers of a Seifert link have left-orderable fundamental groups, and therefore admit co-oriented taut foliations and are not $L$-spaces, if and only if it is not an $ADE$ link up to orientation. This leads to a proof of the $ADE$ link conjecture for Seifert links. When $L$ is an $ADE$ link up to orientation, we determine which of its canonical $n$-fold cyclic branched covers $\Sigma_n(L)$ have non-left-orderable fundamental groups. In addition, we give a topological proof of Ishikawa's classification of strongly quasipositive Seifert links and we determine the Seifert links that are definite, resp. have genus zero, resp. have genus equal to its smooth $4$-ball genus, among others. In the last section, we provide a comprehensive survey of the current knowledge and results concerning the $ADE$ link conjecture.


title: The statistics of Rayleigh-Levy flight extrema

abstract: Rayleigh-Levy flights have played a significant role in cosmology as simplified models for understanding how matter distributes itself under gravitational influence. These models also exhibit numerous remarkable properties that enable the prediction of a wide range of characteristics. Here, we derive the one and two point statistics of extreme points within Rayleigh-Levy flights spanning one to three dimensions, stemming directly from fundamental principles. In the context of the mean field limit, we provide straightforward closed-form expressions for Euler counts and their correlations, particularly in relation to their clustering behaviour over long distances. Additionally, quadratures allow for the computation of extreme value number densities. A comparison between theoretical predictions in 1D and Monte Carlo measurements shows remarkable agreement. Given the widespread use of Rayleigh-Levy processes, these comprehensive findings offer significant promise not only in astrophysics but also in broader applications beyond the field.


title: The influence of the nilpotentlizers on group structur

abstract: For a finite group $G$ and an element $x\in G$, the subset $$ nil_G(x)=\{y\in G \mid <x,y>~~ is ~~ nilpotent\}$$ is called nilpotentizer of $x$ in $G$. In this paper, we give two solvabilty criteria for a finite group by the structure and the size of nilpotentizer of an element on finite group. In fact, we show that if there exists an element $x$ of $G$ such that $nil_G(x)$ generates a maximal subgroup of $G$ and the simple commutator of weight $2 ~~or ~~3$ of elements of $nil_G(x)$ is equal to $1$ or $|nil_G(x)|= p^n$, where $p$ is prime and $n=1, 2$. Then $G$ is a solvable group.


title: A Finite Element Model for Hydro-thermal Convective Flow in a Porous Medium: Effects of Hydraulic Resistivity and Thermal Diffusivity

abstract: In this article, a finite element model is implemented to analyze hydro-thermal convective flow in a porous medium. The mathematical model encompasses Darcy's law for incompressible fluid behavior, which is coupled with a convection-diffusion-type energy equation to characterize the temperature in the porous medium. The current investigation presents an efficient, stable, and accurate finite element discretization for the hydro-thermal convective flow model. The well-posedness of the proposed discrete Galerkin finite element formulation is guaranteed due to the decoupling property and the linearity of the numerical method. Computational experiments confirm the optimal convergence rates for a manufactured solution. Several numerical results are obtained for the variations of the hydraulic resistivity and thermal diffusivity. In the present study, the bottom wall is maintained at a constant higher hot temperature while side vertical walls are thermally insulated and the top wall is maintained at a constant cold temperature. Heat transfer rates at the heated bottom wall are presented in terms of local Nusselt number. A linear variation in hydraulic resistivity and a quadratic variation in thermal diffusivity show an increase in the heat transfer rate.


title: On the conjecture of groups with the same number of centralizer

abstract: For any group G, let $cent(G)$ denote the set of all centralizers of $G$. The authors in \cite{KZ}, Groups with the same number of centralizers, J. Algebra Appl. (2021) 2150012 (6 pages), posed the following conjecture: Let $G$ and $S$ be finite groups. Is it true that if $|Cent(G)|=|Cent(S)|$ and $|G'|=|S'|$, then $G$ is isoclonic to $S$? In this paper, among other things, we give a negative answer to this conjecture.


title: Learning to See Through Dazzle

abstract: Machine vision is susceptible to laser dazzle, where intense laser light can blind and distort its perception of the environment through oversaturation or permanent damage to sensor pixels. Here we employ a wavefront-coded phase mask to diffuse the energy of laser light and introduce a sandwich generative adversarial network (SGAN) to restore images from complex image degradations, such as varying laser-induced image saturation, mask-induced image blurring, unknown lighting conditions, and various noise corruptions. The SGAN architecture combines discriminative and generative methods by wrapping two GANs around a learnable image deconvolution module. In addition, we make use of Fourier feature representations to reduce the spectral bias of neural networks and improve its learning of high-frequency image details. End-to-end training includes the realistic physics-based synthesis of a large set of training data from publicly available images. We trained the SGAN to suppress the peak laser irradiance as high as $10^6$ times the sensor saturation threshold - the point at which camera sensors may experience damage without the mask. The trained model was evaluated on both a synthetic data set and data collected from the laboratory. The proposed image restoration model quantitatively and qualitatively outperforms state-of-the-art methods for a wide range of scene contents, laser powers, incident laser angles, ambient illumination strengths, and noise characteristics.

categories: cs.CV cs.GR cs.LG eess.IV physics.optics


title: On an inequality of Lin, Kim and Hsieh and Strong Subadditivity

abstract: We give an elementary proof of an inequality of Lin, Kim and Hsieh that implies strong subadditivity of the non Neumann entropy.


title: Pretraining Strategy for Neural Potentials

abstract: We propose a mask pretraining method for Graph Neural Networks (GNNs) to improve their performance on fitting potential energy surfaces, particularly in water systems. GNNs are pretrained by recovering spatial information related to masked-out atoms from molecules, then transferred and finetuned on atomic forcefields. Through such pretraining, GNNs learn meaningful prior about structural and underlying physical information of molecule systems that are useful for downstream tasks. From comprehensive experiments and ablation studies, we show that the proposed method improves the accuracy and convergence speed compared to GNNs trained from scratch or using other pretraining techniques such as denoising. On the other hand, our pretraining method is suitable for both energy-centric and force-centric GNNs. This approach showcases its potential to enhance the performance and data efficiency of GNNs in fitting molecular force fields.


title: Barrow black hole variable parameter model connected to information theory

abstract: One of the greatest challenges of theoretical physics today is to unveil the quantum information theory concerning what happens when one bit of information enters the black hole (BH) horizon. The Landauer principle showed that a certain amount of energy is generated when one-bit of information is erased as it enters the event horizon system. In this paper we used the recently developed Barrow BH model to calculate the addition to the area of the event horizon of his toy model by using the Landauer concept. Besides we make this computation considering $\Delta$ as a constant and a variable parameter. We formulate the Barrow parameter ($\Delta$) as a function of the energy/mass, which is new in the Barrow BH literature. We will investigate the differences between the Bekenstein-Hawking entropy ($\Delta=0$) and the fractal ($\Delta=1$) cases concerning the addition in the area of the BH. The asymptotical analysis is also mentioned and we will see that it affects only the fractal case. All the results accomplished here are new concerning BHs in general and the Barrow model literature in particular.


title: Predicting Outcomes in Video Games with Long Short Term Memory Networks

abstract: Forecasting winners in E-sports with real-time analytics has the potential to further engage audiences watching major tournament events. However, making such real-time predictions is challenging due to unpredictable variables within the game involving diverse player strategies and decision-making. Our work attempts to enhance audience engagement within video game tournaments by introducing a real-time method of predicting wins. Our Long Short Term Memory Network (LSTMs) based approach enables efficient predictions of win-lose outcomes by only using the health indicator of each player as a time series. As a proof of concept, we evaluate our model's performance within a classic, two-player arcade game, Super Street Fighter II Turbo. We also benchmark our method against state of the art methods for time series forecasting; i.e. Transformer models found in large language models (LLMs). Finally, we open-source our data set and code in hopes of furthering work in predictive analysis for arcade games.


title: Progressive-Proximity Bit-Flipping for Decoding Surface Codes

abstract: Topological quantum codes, such as toric and surface codes, are excellent candidates for hardware implementation due to their robustness against errors and their local interactions between qubits. However, decoding these codes efficiently remains a challenge: existing decoders often fall short of meeting requirements such as having low computational complexity (ideally linear in the code's blocklength), low decoding latency, and low power consumption. In this paper we propose a novel bit-flipping (BF) decoder tailored for toric and surface codes. We introduce the proximity vector as a heuristic metric for flipping bits, and we develop a new subroutine for correcting a particular class of harmful degenerate errors. Our algorithm achieves linear complexity growth and it can be efficiently implemented as it only involves simple operations such as bit-wise additions, quasi-cyclic permutations and vector-matrix multiplications. The proposed decoder shows a decoding threshold of 7.5% for the 2D toric code and 7% for the rotated planar code over the binary symmetric channel.


title: MultiContrievers: Analysis of Dense Retrieval Representations

abstract: Dense retrievers compress source documents into (possibly lossy) vector representations, yet there is little analysis of what information is lost versus preserved, and how it affects downstream tasks. We conduct the first analysis of the information captured by dense retrievers compared to the language models they are based on (e.g., BERT versus Contriever). We use 25 MultiBert checkpoints as randomized initialisations to train MultiContrievers, a set of 25 contriever models. We test whether specific pieces of information -- such as gender and occupation -- can be extracted from contriever vectors of wikipedia-like documents. We measure this extractability via information theoretic probing. We then examine the relationship of extractability to performance and gender bias, as well as the sensitivity of these results to many random initialisations and data shuffles. We find that (1) contriever models have significantly increased extractability, but extractability usually correlates poorly with benchmark performance 2) gender bias is present, but is not caused by the contriever representations 3) there is high sensitivity to both random initialisation and to data shuffle, suggesting that future retrieval research should test across a wider spread of both.


title: Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency

abstract: We consider gradient descent (GD) with a constant stepsize applied to logistic regression with linearly separable data, where the constant stepsize $\eta$ is so large that the loss initially oscillates. We show that GD exits this initial oscillatory phase rapidly -- in $\mathcal{O}(\eta)$ steps -- and subsequently achieves an $\tilde{\mathcal{O}}(1 / (\eta t) )$ convergence rate after $t$ additional steps. Our results imply that, given a budget of $T$ steps, GD can achieve an accelerated loss of $\tilde{\mathcal{O}}(1/T^2)$ with an aggressive stepsize $\eta:= \Theta( T)$, without any use of momentum or variable stepsize schedulers. Our proof technique is versatile and also handles general classification loss functions (where exponential tails are needed for the $\tilde{\mathcal{O}}(1/T^2)$ acceleration), nonlinear predictors in the neural tangent kernel regime, and online stochastic gradient descent (SGD) with a large stepsize, under suitable separability conditions.


title: Phase diagram of the one dimensional $t_1-t_2-J$ model: Ferromagnetism, triplet pairing, charge and pair density waves

abstract: We present a density matrix renormalization group (DMRG) study of an extended $t-J$ model with hopping to the first and second neighbors -- the one dimensional $t_1-t_2-J$ model. The full phase diagram as a function of the density $n$ and exchange strength $J$, for both positive and negative values of $t_2$, is obtained. For $t_2=-0.5$ we observe that, in the strongly interacting region, Nagaoka Ferromagnetism (FM) is accompanied by a triplet pair density wave (PDW) upon doping. As the spin exchange $J$ increases, a charge density wave (CDW) phase emerges and then gives way to singlet superconductivity (SC). This phase behaves as a singlet PDW with vanishing spacial average of the order parameter and a spin gap. When $t_2=0.5$, the physics is basically reminiscent of the conventional $t-J$ model, undergoing a transition from a metallic to a SC phase as a function of $J$.


title: Advancing BDD Software Testing: Dynamic Scenario Re-Usability And Step Auto-Complete For Cucumber Framework

abstract: This paper presents and implements the re-usability of scenarios within scenarios for behavior-driven development (BDD) Gherkin test scripts in the Cucumber Java framework. Though the focus of the presented work is on scenario re-usability through an implementation within the Cucumber BDD Java framework, the paper also dives a little into the limitations of Cucumber single-threaded scenario execution model. This implementation increases the modularity and efficiency of the test suite. The paper also discusses VSCode step definition auto-completion integration, simplifying the test script writing process. This functionality is handy to Quality Assurance(QA) test writers, allowing instant access to relevant step definitions. In addition, the use of these methods in a popular continuous integration and delivery platform Jenkins as a Maven Java project is discussed. This integration with Jenkins, facilitates for more efficient test automation for continuous deployment scenarios. Empirical research and practical applications reveal significant improvements in the speed and efficiency of test writing, which is especially valuable for large and complex software projects. Integrating these methods into traditional sequential BDD practices paves the way towards more effective, efficient, and sustainable test automation strategies.


title: QuaCer-C: Quantitative Certification of Knowledge Comprehension in LLMs

abstract: Large Language Models (LLMs) have demonstrated impressive performance on several benchmarks. However, traditional studies do not provide formal guarantees on the performance of LLMs. In this work, we propose a novel certification framework for LLM, QuaCer-C, wherein we formally certify the knowledge-comprehension capabilities of popular LLMs. Our certificates are quantitative - they consist of high-confidence, tight bounds on the probability that the target LLM gives the correct answer on any relevant knowledge comprehension prompt. Our certificates for the Llama, Vicuna, and Mistral LLMs indicate that the knowledge comprehension capability improves with an increase in the number of parameters and that the Mistral model is less performant than the rest in this evaluation.


title: Evaluating Prompting Strategies for Grammatical Error Correction Based on Language Proficiency

abstract: The writing examples of English language learners may be different from those of native speakers. Given that there is a significant differences in second language (L2) learners' error types by their proficiency levels, this paper attempts to reduce overcorrection by examining the interaction between LLM's performance and L2 language proficiency. Our method focuses on zero-shot and few-shot prompting and fine-tuning models for GEC for learners of English as a foreign language based on the different proficiency. We investigate GEC results and find that overcorrection happens primarily in advanced language learners' writing (proficiency C) rather than proficiency A (a beginner level) and proficiency B (an intermediate level). Fine-tuned LLMs, and even few-shot prompting with writing examples of English learners, actually tend to exhibit decreased recall measures. To make our claim concrete, we conduct a comprehensive examination of GEC outcomes and their evaluation results based on language proficiency.


title: Frustratingly Simple Prompting-based Text Denoising

abstract: This paper introduces a novel perspective on the automated essay scoring (AES) task, challenging the conventional view of the ASAP dataset as a static entity. Employing simple text denoising techniques using prompting, we explore the dynamic potential within the dataset. While acknowledging the previous emphasis on building regression systems, our paper underscores how making minor changes to a dataset through text denoising can enhance the final results.


title: Scalable Volt-VAR Optimization using RLlib-IMPALA Framework: A Reinforcement Learning Approach

abstract: In the rapidly evolving domain of electrical power systems, the Volt-VAR optimization (VVO) is increasingly critical, especially with the burgeoning integration of renewable energy sources. Traditional approaches to learning-based VVO in expansive and dynamically changing power systems are often hindered by computational complexities. To address this challenge, our research presents a novel framework that harnesses the potential of Deep Reinforcement Learning (DRL), specifically utilizing the Importance Weighted Actor-Learner Architecture (IMPALA) algorithm, executed on the RAY platform. This framework, built upon RLlib-an industry-standard in Reinforcement Learning-ingeniously capitalizes on the distributed computing capabilities and advanced hyperparameter tuning offered by RAY. This design significantly expedites the exploration and exploitation phases in the VVO solution space. Our empirical results demonstrate that our approach not only surpasses existing DRL methods in achieving superior reward outcomes but also manifests a remarkable tenfold reduction in computational requirements. The integration of our DRL agent with the RAY platform facilitates the creation of RLlib-IMPALA, a novel framework that efficiently uses RAY's resources to improve system adaptability and control. RLlib-IMPALA leverages RAY's toolkit to enhance analytical capabilities and significantly speeds up training to become more than 10 times faster than other state-of-the-art DRL methods.


title: Bridging the Gap between 2D and 3D Visual Question Answering: A Fusion Approach for 3D VQA

abstract: In 3D Visual Question Answering (3D VQA), the scarcity of fully annotated data and limited visual content diversity hampers the generalization to novel scenes and 3D concepts (e.g., only around 800 scenes are utilized in ScanQA and SQA dataset). Current approaches resort supplement 3D reasoning with 2D information. However, these methods face challenges: either they use top-down 2D views that introduce overly complex and sometimes question-irrelevant visual clues, or they rely on globally aggregated scene/image-level representations from 2D VLMs, losing the fine-grained vision-language correlations. To overcome these limitations, our approach utilizes question-conditional 2D view selection procedure, pinpointing semantically relevant 2D inputs for crucial visual clues. We then integrate this 2D knowledge into the 3D-VQA system via a two-branch Transformer structure. This structure, featuring a Twin-Transformer design, compactly combines 2D and 3D modalities and captures fine-grained correlations between modalities, allowing them mutually augmenting each other. Integrating proposed mechanisms above, we present BridgeQA, that offers a fresh perspective on multi-modal transformer-based architectures for 3D-VQA. Experiments validate that BridgeQA achieves state-of-the-art on 3D-VQA datasets and significantly outperforms existing solutions. Code is available at $\href{https://github.com/matthewdm0816/BridgeQA}{\text{this URL}}$.


title: Multivariable pseudospectrum in $C^*$-algebras

abstract: We look at various forms of spectrum and associated pseudospectrum that can be defined for noncommuting $d$-tuples of Hermitian elements of a $C^*$-algebra. The emphasis is on theoretical calculations of examples, in particular for noncommuting pairs and triple of operators on infinite dimensional Hilbert space. In particular, we look at the universal pair of projections in a $C^*$-algebra, the usual position and momentum operators, and triples of tridiagonal operators.


title: Pulsation in TESS Objects of Interest

abstract: We report the discovery of three Transiting Exoplanet Survey Satellite Objects of Interest (TOI) with signatures of pulsation, observed in more than one sector. Our main goal is to explore how large is the variety of classical pulsators such as $\delta$ Sct, $\gamma$ Dor, RR Lyrae and Cepheid among TOI pulsators. The analysis reveals two stars with signatures of $\delta$ Sct and one of $\gamma$ Dor, out of a sample of 3901 TOIs with available light curves (LCs). To date, there is a very scarce number of known pulsating stars hosting planets. The present finding also emerges as an exciting laboratory for studying different astrophysical phenomena, including the effects of star-planet interaction on pulsation and timing detection of planetary companions. We have also identified 16 TOI stars with periodicities and LCs morphology compatible with different classical pulsating classes, but for most of them, the dominant frequency signals originate from contaminating sources.


title: Optimizing Neural Networks for Bermudan Option Pricing: Convergence Acceleration, Future Exposure Evaluation and Interpolation in Counterparty Credit Risk

abstract: This paper presents a Monte-Carlo-based artificial neural network framework for pricing Bermudan options, offering several notable advantages. These advantages encompass the efficient static hedging of the target Bermudan option and the effective generation of exposure profiles for risk management. We also introduce a novel optimisation algorithm designed to expedite the convergence of the neural network framework proposed by Lokeshwar et al. (2022) supported by a comprehensive error convergence analysis. We conduct an extensive comparative analysis of the Present Value (PV) distribution under Markovian and no-arbitrage assumptions. We compare the proposed neural network model in conjunction with the approach initially introduced by Longstaff and Schwartz (2001) and benchmark it against the COS model, the pricing model pioneered by Fang and Oosterlee (2009), across all Bermudan exercise time points. Additionally, we evaluate exposure profiles, including Expected Exposure and Potential Future Exposure, generated by our proposed model and the Longstaff-Schwartz model, comparing them against the COS model. We also derive exposure profiles at finer non-standard grid points or risk horizons using the proposed approach, juxtaposed with the Longstaff Schwartz method with linear interpolation and benchmark against the COS method. In addition, we explore the effectiveness of various interpolation schemes within the context of the Longstaff-Schwartz method for generating exposures at finer grid horizons.


title: Interpolation-based immersogeometric analysis methods for multi-material and multi-physics problems

abstract: Immersed boundary methods are high-order accurate computational tools used to model geometrically complex problems in computational mechanics. While traditional finite element methods require the construction of high-quality boundary-fitted meshes, immersed boundary methods instead embed the computational domain in a background grid. Interpolation-based immersed boundary methods augment existing finite element software to non-invasively implement immersed boundary capabilities through extraction. Extraction interpolates the background basis as a linear combination of Lagrange polynomials defined on a foreground mesh, creating an interpolated basis that can be easily integrated by existing methods. This work extends the interpolation-based immersed boundary method to multi-material and multi-physics problems. Beginning from level-set descriptions of domain geometries, Heaviside enrichment is implemented to accommodate discontinuities in state variable fields across material interfaces. Adaptive refinement with truncated hierarchical B-splines is used to both improve interface geometry representations and resolve large solution gradients near interfaces. Multi-physics problems typically involve coupled fields where each field has unique discretization requirements. This work presents a novel discretization method for coupled problems through the application of extraction, using a single foreground mesh for all fields. Numerical examples illustrate optimal convergence rates for this method in both 2D and 3D, for heat conduction, linear elasticity, and a coupled thermo-mechanical problem. The utility of this method is demonstrated through image-based analysis of a composite sample, where in addition to circumventing typical meshing difficulties, this method reduces the required degrees of freedom compared to classical boundary-fitted finite element methods.


title: Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

abstract: Recent statements about the impressive capabilities of large language models (LLMs) are usually supported by evaluating on open-access benchmarks. Considering the vast size and wide-ranging sources of LLMs' training data, it could explicitly or implicitly include test data, leading to LLMs being more susceptible to data contamination. However, due to the opacity of training data, the black-box access of models, and the rapid growth of synthetic training data, detecting and mitigating data contamination for LLMs faces significant challenges. In this paper, we propose CDD, which stands for Contamination Detection via output Distribution for LLMs. CDD necessitates only the sampled texts to detect data contamination, by identifying the peakedness of LLM's output distribution. To mitigate the impact of data contamination in evaluation, we also present TED: Trustworthy Evaluation via output Distribution, based on the correction of LLM's output distribution. To facilitate this study, we introduce two benchmarks, i.e., DetCon and ComiEval, for data contamination detection and contamination mitigation evaluation tasks. Extensive experimental results show that CDD achieves the average relative improvements of 21.8\%-30.2\% over other contamination detection approaches in terms of Accuracy, F1 Score, and AUC metrics, and can effectively detect implicit contamination. TED substantially mitigates performance improvements up to 66.9\% attributed to data contamination across various contamination setups. In real-world applications, we reveal that ChatGPT exhibits a high potential to suffer from data contamination on HumanEval benchmark.


title: Deep Separable Spatiotemporal Learning for Fast Dynamic Cardiac MRI

abstract: Dynamic magnetic resonance imaging (MRI) plays an indispensable role in cardiac diagnosis. To enable fast imaging, the k-space data can be undersampled but the image reconstruction poses a great challenge of high-dimensional processing. This challenge leads to necessitate extensive training data in many deep learning reconstruction methods. This work proposes a novel and efficient approach, leveraging a dimension-reduced separable learning scheme that excels even with highly limited training data. We further integrate it with spatiotemporal priors to develop a Deep Separable Spatiotemporal Learning network (DeepSSL), which unrolls an iteration process of a reconstruction model with both temporal low-rankness and spatial sparsity. Intermediate outputs are visualized to provide insights into the network's behavior and enhance its interpretability. Extensive results on cardiac cine datasets show that the proposed DeepSSL is superior to the state-of-the-art methods visually and quantitatively, while reducing the demand for training cases by up to 75%. And its preliminary adaptability to cardiac patients has been verified through experienced radiologists' and cardiologists' blind reader study. Additionally, DeepSSL also benefits for achieving the downstream task of cardiac segmentation with higher accuracy and shows robustness in prospective real-time cardiac MRI.


title: High-performance finite elements with MFEM

abstract: The MFEM (Modular Finite Element Methods) library is a high-performance C++ library for finite element discretizations. MFEM supports numerous types of finite element methods and is the discretization engine powering many computational physics and engineering applications across a number of domains. This paper describes some of the recent research and development in MFEM, focusing on performance portability across leadership-class supercomputing facilities, including exascale supercomputers, as well as new capabilities and functionality, enabling a wider range of applications. Much of this work was undertaken as part of the Department of Energy's Exascale Computing Project (ECP) in collaboration with the Center for Efficient Exascale Discretizations (CEED).


title: Implementing Recycling Methods for Linear Systems in Python with an Application to Multiple Objective Optimization

abstract: Sequences of linear systems arise in the predictor-corrector method when computing the Pareto front for multi-objective optimization. Rather than discarding information generated when solving one system, it may be advantageous to recycle information for subsequent systems. To accomplish this, we seek to reduce the overall cost of computation when solving linear systems using common recycling methods. In this work, we assessed the performance of recycling minimum residual (RMINRES) method along with a map between coefficient matrices. For these methods to be fully integrated into the software used in Enouen et al. (2022), there must be working version of each in both Python and PyTorch. Herein, we discuss the challenges we encountered and solutions undertaken (and some ongoing) when computing efficient Python implementations of these recycling strategies. The goal of this project was to implement RMINRES in Python and PyTorch and add it to the established Pareto front code to reduce computational cost. Additionally, we wanted to implement the sparse approximate maps code in Python and PyTorch, so that it can be parallelized in future work.


title: Minimum energy density steering of linear systems with Gromov-Wasserstein terminal cost

abstract: In this paper, we newly formulate and solve the optimal density control problem with Gromov-Wasserstein (GW) terminal cost in discrete-time linear Gaussian systems. Differently from the Wasserstein or Kullback-Leibler distances employed in the existing works, the GW distance quantifies the difference in shapes of the distribution, which is invariant under translation and rotation. Consequently, our formulation allows us to find small energy inputs that achieve the desired shape of the terminal distribution, which has practical applications, e.g., robotic swarms. We demonstrate that the problem can be reduced to a Difference of Convex (DC) programming, which is efficiently solvable through the DC algorithm. Through numerical experiments, we confirm that the state distribution reaches the terminal distribution that can be realized with the minimum control energy among those having the specified shape.


title: Rethinking Software Engineering in the Foundation Model Era: A Curated Catalogue of Challenges in the Development of Trustworthy FMware

abstract: Foundation models (FMs), such as Large Language Models (LLMs), have revolutionized software development by enabling new use cases and business models. We refer to software built using FMs as FMware. The unique properties of FMware (e.g., prompts, agents, and the need for orchestration), coupled with the intrinsic limitations of FMs (e.g., hallucination) lead to a completely new set of software engineering challenges. Based on our industrial experience, we identified 10 key SE4FMware challenges that have caused enterprise FMware development to be unproductive, costly, and risky. In this paper, we discuss these challenges in detail and state the path for innovation that we envision. Next, we present FMArts, which is our long-term effort towards creating a cradle-to-grave platform for the engineering of trustworthy FMware. Finally, we (i) show how the unique properties of FMArts enabled us to design and develop a complex FMware for a large customer in a timely manner and (ii) discuss the lessons that we learned in doing so. We hope that the disclosure of the aforementioned challenges and our associated efforts to tackle them will not only raise awareness but also promote deeper and further discussions, knowledge sharing, and innovative solutions across the software engineering discipline.


title: On A Class of Greedy Sparse Recovery Algorithms -- A High Dimensional Approach

abstract: Sparse signal recovery deals with finding the sparest solution of an under-determined linear system $x = Qs$. In this paper, we propose a novel greedy approach to addressing the challenges from such a problem. Such an approach is based on a characterization of solutions to the system, which allows us to work on the sparse recovery in the $s$-space directly with a given measure. With $l_2$-based measure, two OMP-type algorithms are proposed, which significantly outperform the classical OMP algorithm in terms of recovery accuracy while maintaining comparable computational complexity. An $l_1$-based algorithm, denoted as $\text{Alg}_{GBP}$ (greedy basis pursuit) algorithm, is derived. Such an algorithm significantly outperforms the classical BP algorithm. A CoSaMP-type algorithm is also proposed to further enhance the performance of the two proposed OMP-type algorithms. The superior performance of our proposed algorithms is demonstrated through extensive numerical simulations using synthetic data as well as video signals, highlighting their potential for various applications in compressed sensing and signal processing.


title: Attention-GAN for Anomaly Detection: A Cutting-Edge Approach to Cybersecurity Threat Management

abstract: This paper proposes an innovative Attention-GAN framework for enhancing cybersecurity, focusing on anomaly detection. In response to the challenges posed by the constantly evolving nature of cyber threats, the proposed approach aims to generate diverse and realistic synthetic attack scenarios, thereby enriching the dataset and improving threat identification. Integrating attention mechanisms with Generative Adversarial Networks (GANs) is a key feature of the proposed method. The attention mechanism enhances the model's ability to focus on relevant features, essential for detecting subtle and complex attack patterns. In addition, GANs address the issue of data scarcity by generating additional varied attack data, encompassing known and emerging threats. This dual approach ensures that the system remains relevant and effective against the continuously evolving cyberattacks. The KDD Cup and CICIDS2017 datasets were used to validate this model, which exhibited significant improvements in anomaly detection. It achieved an accuracy of 99.69% on the KDD dataset and 97.93% on the CICIDS2017 dataset, with precision, recall, and F1-scores above 97%, demonstrating its effectiveness in recognizing complex attack patterns. This study contributes significantly to cybersecurity by providing a scalable and adaptable solution for anomaly detection in the face of sophisticated and dynamic cyber threats. The exploration of GANs for data augmentation highlights a promising direction for future research, particularly in situations where data limitations restrict the development of cybersecurity systems. The attention-GAN framework has emerged as a pioneering approach, setting a new benchmark for advanced cyber-defense strategies.


title: On the evolution of topological connectivity by thresholding of affinities. An application to public transport

abstract: In this paper we use the neighborhood topology generated by affinities between pairs of points in a set, in orden to explore the underlying dynamics of connectivity by thresholding of the affinity. We apply the method to the connectivity provided by the public transport system in Buenos Aires.


title: Hyper-algebraic invariants of $p$-adic algebraic numbers

abstract: Let $p\geq 3$ be a prime. In this article, we introduce two arithmetic invariants (hyper-tame index and hyper-inertia index) of the hyper-algebraic elements in the $p$-adic Mal'cev-Neumann field $\mathbb{L}_p$. For $p$-adic algebraic numbers that generate abelian extensions and tamely ramified extensions of $\mathbb{Q}_p$, we calculate their hyper-tame indexes and hyper-inertia indexes.


title: Criticality measure-based error estimates for infinite dimensional optimization

abstract: Motivated by optimization with differential equations, we consider optimization problems with Hilbert spaces as decision spaces. As a consequence of their infinite dimensionality, the numerical solution necessitates finite dimensional approximations and discretizations. We develop an approximation framework and demonstrate criticality measure-based error estimates. We consider criticality measures inspired by those used within optimization methods, such as semismooth Newton and (conditional) gradient methods. Furthermore, we show that our error estimates are order-optimal. Our findings augment existing distance-based error estimates, but do not rely on strong convexity or second-order sufficient optimality conditions. Moreover, our error estimates can be used for code verification and validation. We illustrate our theoretical convergence rates on linear, semilinear, and bilinear PDE-constrained optimization.


title: Ultrastrong coupling between polar distortion and optical properties in ferroelectric MoBr$_2$O$_2$

abstract: Tuning the properties of materials using external stimuli is crucial for developing versatile smart materials. A strong coupling among order parameters within a single-phase material constitutes a potent foundation for achieving precise property control. However, cross-coupling is pretty weak in most single materials. Leveraging first principles calculations, we demonstrate the layered mixed anion compound MoBr$_2$O$_2$ exhibits electric-field switchable spontaneous polarization and ultrastrong coupling between polar distortion and electronic structures as well as optical properties. It offers feasible avenues of achieving tunable Rashba spin-splitting, electrochromism, thermochromism, photochromism, and nonlinear optics by applying an external electric field to a single domain sample, heating, as well as intense light illumination. Additionally, it exhibits an exceptionally large photostrictive effect. These findings not only showcase the feasibility of achieving multiple order parameter coupling within a single material, but also pave the way for comprehensive applications based on property control, such as energy harvesting, information processing, and ultrafast control.


title: Fourier series for singular measures in higher dimensions

abstract: For multi-variable finite measure spaces, we present in this paper a new framework for non-orthogonal $L^2$ Fourier expansions. Our results hold for probability measures $\mu$ with finite support in $\mathbb{R}^d$ that satisfy a certain disintegration condition that we refer to as ``slice-singular''. In this general framework, we present explicit $L^{2}(\mu)$-Fourier expansions, with Fourier exponentials having positive Fourier frequencies in each of the d coordinates. Our Fourier representations apply to every $f \in L^2(\mu)$, are based on an extended Kaczmarz algorithm, and use a new recursive $\mu$ Rokhlin disintegration representation. In detail, our Fourier series expansion for $f$ is in terms of the multivariate Fourier exponentials $\{e_n\}$, but the associated Fourier coefficients for $f$ are now computed from a Kaczmarz system $\{g_n\}$ in $L^{2}(\mu)$ which is dual to the Fourier exponentials. The $\{g_n\}$ system is shown to be a Parseval frame for $L^{2}(\mu)$. Explicit computations for our new Fourier expansions entail a detailed analysis of subspaces of the Hardy space on the polydisk, dual to $L^{2}(\mu)$, and an associated d-variable Normalized Cauchy Transform. Our results extend earlier work for measures $\mu$ in one and two dimensions, i.e., $d=1 (\mu $ singular), and $d=2 (\mu$ assumed slice-singular). Here our focus is the extension to the cases of measures $\mu$ in dimensions $d >2$. Our results are illustrated with the use of explicit iterated function systems (IFSs), including the IFS generated Menger sponge for $d=3$.


title: GreenLLaMA: A Framework for Detoxification with Explanations

abstract: Prior works on detoxification are scattered in the sense that they do not cover all aspects of detoxification needed in a real-world scenario. Notably, prior works restrict the task of developing detoxification models to only a seen subset of platforms, leaving the question of how the models would perform on unseen platforms unexplored. Additionally, these works do not address non-detoxifiability, a phenomenon whereby the toxic text cannot be detoxified without altering the meaning. We propose GreenLLaMA, the first comprehensive end-to-end detoxification framework, which attempts to alleviate the aforementioned limitations. We first introduce a cross-platform pseudo-parallel corpus applying multi-step data processing and generation strategies leveraging ChatGPT. We then train a suite of detoxification models with our cross-platform corpus. We show that our detoxification models outperform the SoTA model trained with human-annotated parallel corpus. We further introduce explanation to promote transparency and trustworthiness. GreenLLaMA additionally offers a unique paraphrase detector especially dedicated for the detoxification task to tackle the non-detoxifiable cases. Through experimental analysis, we demonstrate the effectiveness of our cross-platform corpus and the robustness of GreenLLaMA against adversarial toxicity.


title: ViSTec: Video Modeling for Sports Technique Recognition and Tactical Analysis

abstract: The immense popularity of racket sports has fueled substantial demand in tactical analysis with broadcast videos. However, existing manual methods require laborious annotation, and recent attempts leveraging video perception models are limited to low-level annotations like ball trajectories, overlooking tactics that necessitate an understanding of stroke techniques. State-of-the-art action segmentation models also struggle with technique recognition due to frequent occlusions and motion-induced blurring in racket sports videos. To address these challenges, We propose ViSTec, a Video-based Sports Technique recognition model inspired by human cognition that synergizes sparse visual data with rich contextual insights. Our approach integrates a graph to explicitly model strategic knowledge in stroke sequences and enhance technique recognition with contextual inductive bias. A two-stage action perception model is jointly trained to align with the contextual knowledge in the graph. Experiments demonstrate that our method outperforms existing models by a significant margin. Case studies with experts from the Chinese national table tennis team validate our model's capacity to automate analysis for technical actions and tactical strategies. More details are available at: https://ViSTec2024.github.io/.


title: Convolution and Cross-Correlation of Count Sketches Enables Fast Cardinality Estimation of Multi-Join Queries

abstract: With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more data streams while operating under memory constraints. The primary challenge arises from the rapid influx of new items, requiring algorithms that enable efficient incremental processing of streams in order to keep up. A prominent algorithm in this domain is the AMS sketch. Originally developed to estimate the second frequency moment of a data stream, it can also estimate the cardinality of the equi-join between two relations. Since then, two important advancements are the Count sketch, a method which significantly improves upon the sketch update time, and secondly, an extension of the AMS sketch to accommodate multi-join queries. However, combining the strengths of these methods to maintain sketches for multi-join queries while ensuring fast update times is a non-trivial task, and has remained an open problem for decades as highlighted in the existing literature. In this work, we successfully address this problem by introducing a novel sketching method which has fast updates, even for sketches capable of accurately estimating the cardinality of complex multi-join queries. We prove that our estimator is unbiased and has the same error guarantees as the AMS-based method. Our experimental results confirm the significant improvement in update time complexity, resulting in orders of magnitude faster estimates, with equal or better estimation accuracy.


title: Forward and inverse modeling of depth-of-field effects in background-oriented schlieren

abstract: We report a novel "cone-ray" model of background-oriented schlieren (BOS) imaging that accounts for depth-of-field effects. Reconstructions of the density field performed with this model are far more robust to the blur associated with a finite aperture than conventional reconstructions, which presume a "thin-ray" pinhole camera. Our model is characterized and validated using forward evaluations based on simulated and experimental BOS measurements of buoyancy-driven flow and hypersonic flow over a sphere. Moreover, we embed the model in a neural reconstruction algorithm, which is demonstrated with a total variation penalty as well as the compressible Euler equations. Our cone-ray technique dramatically improves the accuracy of BOS reconstructions: the shock interface is well-resolved in all our tests, irrespective of the camera's aperture setting, which spans f-numbers from 22 down to 4.


title: Direct and Inverse scattering in a three-dimensional planar waveguide

abstract: In this paper, we study the direct and inverse scattering of the Schr\"odinger equation in a three-dimensional planar waveguide. For the direct problem, we derive a resonance-free region and resolvent estimates for the resolvent of the Schr\"odinger operator in such a geometry. Based on the analysis of the resolvent, several inverse problems are investigated. First, given the potential function, we prove the uniqueness of the inverse source problem with multi-frequency data. We also develop a Fourier-based method to reconstruct the source function. The capability of this method is numerically illustrated by examples. Second, the uniqueness and increased stability of an inverse potential problem from data generated by incident waves are achieved in the absence of the source function. To derive the stability estimate, we use an argument of quantitative analytic continuation in complex theory. Third, we prove the uniqueness of simultaneously determining the source and potential by active boundary data generated by incident waves. In these inverse problems, we only use the limited lateral Dirichlet boundary data at multiple wavenumbers within a finite interval.


title: Anti-Instability of Complex Ghost

abstract: We argue that Lee-Wick's complex ghost appearing in any higher derivative theory is stable and its asymptotic field exists. It may be more appropriate to call it ``anti-unstable" in the sense that, the more the ghost `decays' into lighter ordinary particles, the larger the probability the ghost remains as itself becomes. This is explicitly shown by analyzing the two-point functions of the ghost Heisenberg field which is obtained as an exact result in the $N\rightarrow\infty$ limit in a massive scalar ghost theory with light $O(N)$-vector scalar matter. The anti-instability is a consequence of the fact that the poles of the complex ghost propagator are located on the physical sheet in the complex plane of four-momentum squared. This should be contrasted to the case of the ordinary unstable particle, whose propagator has no pole on the physical sheet.


title: DynaMITE-RL: A Dynamic Model for Improved Temporal Meta-Reinforcement Learning

abstract: We introduce DynaMITE-RL, a meta-reinforcement learning (meta-RL) approach to approximate inference in environments where the latent state evolves at varying rates. We model episode sessions - parts of the episode where the latent state is fixed - and propose three key modifications to existing meta-RL methods: consistency of latent information within sessions, session masking, and prior latent conditioning. We demonstrate the importance of these modifications in various domains, ranging from discrete Gridworld environments to continuous-control and simulated robot assistive tasks, demonstrating that DynaMITE-RL significantly outperforms state-of-the-art baselines in sample efficiency and inference returns.


title: On the dynamics of three-layer neural networks: initial condensation

abstract: Empirical and theoretical works show that the input weights of two-layer neural networks, when initialized with small values, converge towards isolated orientations. This phenomenon, referred to as condensation, indicates that the gradient descent methods tend to spontaneously reduce the complexity of neural networks during the training process. In this work, we elucidate the mechanisms behind the condensation phenomena occurring in the training of three-layer neural networks and distinguish it from the training of two-layer neural networks. Through rigorous theoretical analysis, we establish the blow-up property of effective dynamics and present a sufficient condition for the occurrence of condensation, findings that are substantiated by experimental results. Additionally, we explore the association between condensation and the low-rank bias observed in deep matrix factorization.


title: Towards Robust Image Stitching: An Adaptive Resistance Learning against Compatible Attacks

abstract: Image stitching seamlessly integrates images captured from varying perspectives into a single wide field-of-view image. Such integration not only broadens the captured scene but also augments holistic perception in computer vision applications. Given a pair of captured images, subtle perturbations and distortions which go unnoticed by the human visual system tend to attack the correspondence matching, impairing the performance of image stitching algorithms. In light of this challenge, this paper presents the first attempt to improve the robustness of image stitching against adversarial attacks. Specifically, we introduce a stitching-oriented attack~(SoA), tailored to amplify the alignment loss within overlapping regions, thereby targeting the feature matching procedure. To establish an attack resistant model, we delve into the robustness of stitching architecture and develop an adaptive adversarial training~(AAT) to balance attack resistance with stitching precision. In this way, we relieve the gap between the routine adversarial training and benign models, ensuring resilience without quality compromise. Comprehensive evaluation across real-world and synthetic datasets validate the deterioration of SoA on stitching performance. Furthermore, AAT emerges as a more robust solution against adversarial perturbations, delivering superior stitching results. Code is available at:https://github.com/Jzy2017/TRIS.


title: Budget-Constrained Tool Learning with Planning

abstract: Despite intensive efforts devoted to tool learning, the problem of budget-constrained tool learning, which focuses on resolving user queries within a specific budget constraint, has been widely overlooked. This paper proposes a novel method for budget-constrained tool learning. Our approach involves creating a preferable plan under the budget constraint before utilizing the tools. This plan outlines the feasible tools and the maximum number of times they can be employed, offering a comprehensive overview of the tool learning process for large language models. This allows them to allocate the budget from a broader perspective. To devise the plan without incurring significant extra costs, we suggest initially estimating the usefulness of the candidate tools based on past experience. Subsequently, we employ dynamic programming to formulate the plan. Experimental results demonstrate that our method can be integrated with various tool learning methods, significantly enhancing their effectiveness under strict budget constraints.


title: VOLoc: Visual Place Recognition by Querying Compressed Lidar Map

abstract: The availability of city-scale Lidar maps enables the potential of city-scale place recognition using mobile cameras. However, the city-scale Lidar maps generally need to be compressed for storage efficiency, which increases the difficulty of direct visual place recognition in compressed Lidar maps. This paper proposes VOLoc, an accurate and efficient visual place recognition method that exploits geometric similarity to directly query the compressed Lidar map via the real-time captured image sequence. In the offline phase, VOLoc compresses the Lidar maps using a \emph{Geometry-Preserving Compressor} (GPC), in which the compression is reversible, a crucial requirement for the downstream 6DoF pose estimation. In the online phase, VOLoc proposes an online Geometric Recovery Module (GRM), which is composed of online Visual Odometry (VO) and a point cloud optimization module, such that the local scene structure around the camera is online recovered to build the \emph{Querying Point Cloud} (QPC). Then the QPC is compressed by the same GPC, and is aggregated into a global descriptor by an attention-based aggregation module, to query the compressed Lidar map in the vector space. A transfer learning mechanism is also proposed to improve the accuracy and the generality of the aggregation network. Extensive evaluations show that VOLoc provides localization accuracy even better than the Lidar-to-Lidar place recognition, setting up a new record for utilizing the compressed Lidar map by low-end mobile cameras. The code are publicly available at https://github.com/Master-cai/VOLoc.


title: Hierarchical energy signatures using machine learning for operational visibility and diagnostics in automotive manufacturing

abstract: Manufacturing energy consumption data contains important process signatures required for operational visibility and diagnostics. These signatures may be of different temporal scales, ranging from monthly to sub-second resolutions. We introduce a hierarchical machine learning approach to identify automotive process signatures from paint shop electricity consumption data at varying temporal scales (weekly and daily). A Multi-Layer Perceptron (MLP), a Convolutional Neural Network (CNN), and Principal Component Analysis (PCA) combined with Logistic Regression (LR) are used for the analysis. We validate the utility of the developed algorithms with subject matter experts for (i) better operational visibility, and (ii) identifying energy saving opportunities.


title: Transport properties of asymmetric nuclear matter in the spinodal region

abstract: We have studied the shear and bulk viscosities of asymmetric nuclear matter in the mechanical and chemical instability region based on IBUU transport simulations in a box system. The Green-Kubo method is used to calculate these viscosities with a prepared dynamically equilibrated nuclear system with hot clusters. While the behavior of the shear viscosity is largely affected by energy-dependent nucleon-nucleon cross sections, the bulk viscosity increases significantly in the presence of nuclear clusters compared to that in uniform nuclear matter. Increasing isospin asymmetry generally increases both viscosities, while their behaviors are qualitatively modified once the isospin asymmetry is large enough to affect significantly the spinodal region. Our calculation shows that the bulk viscosity is more sensitive to the nuclear clustering than the shear viscosity, and is thus a robust quantity related to the phase diagram of asymmetric nuclear matter.


title: Probing Topology of Gaussian Mixed States by the Full Counting Statistics

abstract: Topological band theory has been studied for free fermions for decades, and one of the most profound physical results is the bulk-boundary correspondence. Recently a trend in topological physics is extending topological classification to mixed state. Here, we focus on Gaussian mixed states where the modular Hamiltonians of the density matrix are quadratic free fermion models and can be classified by topological invariants. The bulk-boundary correspondence is then manifested as stable gapless modes of the modular Hamiltonian and degenerate spectrum of the density matrix. In this letter, we show that these gapless modes can be detected by the full counting statistics, mathematically described by a function introduced as F({\theta}). We show that a divergent derivative at {\theta} = {\pi} probes the gapless modes in the modular Hamiltonian. We can introduce a topological indicator whose quantization to unity senses topologically nontrivial mixed states. We present the physical intuition of these results and also demonstrate these results with concrete models in both one- and two-dimensions. Our results pave the way for revealing the physical significance of topology in mixed states.

categories: cond-mat.mes-hall cond-mat.quant-gas cond-mat.stat-mech cond-mat.str-el quant-ph


title: Evolving E-commerce Logistics Planning- Integrating Embedded Technology and Ant Colony Algorithm for Enhanced Efficiency

abstract: Amidst the era of networking, the e-commerce sector has undergone notable expansion, notably with the advent of Cross-border E-commerce (CBEC) in recent times. This growth trend persists, necessitating robust logistical frameworks to sustainably support operations. However, the current e-commerce logistics paradigm faces challenges in meeting evolving user demands, prompting a quest for innovative solutions. This research endeavors to address these complexities by undertaking a comprehensive analysis of CBEC logistics models and integrating embedded technology into logistical frameworks, resulting in the development of an advanced logistics tracking system. Moreover, employing the ant colony algorithm, the study conducts experimental investigations into optimizing logistics package distribution route planning. Noteworthy enhancements are observed in key metrics such as average delivery time, signaling the efficacy of this approach. In essence, this research offers a promising pathway towards optimizing logistics package distribution routes and bolstering package transportation efficiency within the CBEC domain.


title: Data-driven micromorphic mechanics for materials with strain localization

abstract: This paper explores the role of generalized continuum mechanics, and the feasibility of model-free data-driven computing approaches thereof, in solids undergoing failure by strain localization. Specifically, we set forth a methodology for capturing material instabilities using data-driven mechanics without prior information regarding the failure mode. We show numerically that, in problems involving strain localization, the standard data-driven framework for Cauchy/Boltzmann continua fails to capture the length scale of the material, as expected. We address this shortcoming by formulating a generalized data-driven framework for micromorphic continua that effectively captures both stiffness and length-scale information, as encoded in the material data, in a model-free manner. These properties are exhibited systematically in a one-dimensional softening bar problem and further verified through selected plane-strain problems.


title: Direct Punjabi to English speech translation using discrete units

abstract: Speech-to-speech translation is yet to reach the same level of coverage as text-to-text translation systems. The current speech technology is highly limited in its coverage of over 7000 languages spoken worldwide, leaving more than half of the population deprived of such technology and shared experiences. With voice-assisted technology (such as social robots and speech-to-text apps) and auditory content (such as podcasts and lectures) on the rise, ensuring that the technology is available for all is more important than ever. Speech translation can play a vital role in mitigating technological disparity and creating a more inclusive society. With a motive to contribute towards speech translation research for low-resource languages, our work presents a direct speech-to-speech translation model for one of the Indic languages called Punjabi to English. Additionally, we explore the performance of using a discrete representation of speech called discrete acoustic units as input to the Transformer-based translation model. The model, abbreviated as Unit-to-Unit Translation (U2UT), takes a sequence of discrete units of the source language (the language being translated from) and outputs a sequence of discrete units of the target language (the language being translated to). Our results show that the U2UT model performs better than the Speech-to-Unit Translation (S2UT) model by a 3.69 BLEU score.


title: CoDream: Exchanging dreams instead of models for federated aggregation with heterogeneous models

abstract: Federated Learning (FL) enables collaborative optimization of machine learning models across decentralized data by aggregating model parameters. Our approach extends this concept by aggregating "knowledge" derived from models, instead of model parameters. We present a novel framework called CoDream, where clients collaboratively optimize randomly initialized data using federated optimization in the input data space, similar to how randomly initialized model parameters are optimized in FL. Our key insight is that jointly optimizing this data can effectively capture the properties of the global data distribution. Sharing knowledge in data space offers numerous benefits: (1) model-agnostic collaborative learning, i.e., different clients can have different model architectures; (2) communication that is independent of the model size, eliminating scalability concerns with model parameters; (3) compatibility with secure aggregation, thus preserving the privacy benefits of federated learning; (4) allowing of adaptive optimization of knowledge shared for personalized learning. We empirically validate CoDream on standard FL tasks, demonstrating competitive performance despite not sharing model parameters. Our code: https://mitmedialab.github.io/codream.github.io/


title: Efficient Online Learning for Networks of Two-Compartment Spiking Neurons

abstract: The brain-inspired Spiking Neural Networks (SNNs) have garnered considerable research interest due to their superior performance and energy efficiency in processing temporal signals. Recently, a novel multi-compartment spiking neuron model, namely the Two-Compartment LIF (TC-LIF) model, has been proposed and exhibited a remarkable capacity for sequential modelling. However, training the TC-LIF model presents challenges stemming from the large memory consumption and the issue of gradient vanishing associated with the Backpropagation Through Time (BPTT) algorithm. To address these challenges, online learning methodologies emerge as a promising solution. Yet, to date, the application of online learning methods in SNNs has been predominantly confined to simplified Leaky Integrate-and-Fire (LIF) neuron models. In this paper, we present a novel online learning method specifically tailored for networks of TC-LIF neurons. Additionally, we propose a refined TC-LIF neuron model called Adaptive TC-LIF, which is carefully designed to enhance temporal information integration in online learning scenarios. Extensive experiments, conducted on various sequential benchmarks, demonstrate that our approach successfully preserves the superior sequential modeling capabilities of the TC-LIF neuron while incorporating the training efficiency and hardware friendliness of online learning. As a result, it offers a multitude of opportunities to leverage neuromorphic solutions for processing temporal signals.


title: A Markovian regime-switching stochastic SEQIR epidemic model with governmental policy

abstract: In this paper, a stochastic SEQIR epidemic model with Markovian regime-switching is proposed and investigated. The governmental policy and implement efficiency are concerned by a generalized incidence function of the susceptible class. We have the existence and uniqueness of the globally positive solution to the stochastic model by using the Lyapunov method. In addition, we study the dynamical behaviors of the disease, and the sufficient conditions for the extinction and persistence in mean are obtained. Finally, numerical simulations are introduced to demonstrate the theoretical results.


title: Evaporation of acoustically levitated bicomponent droplets: mass and heat transfer characteristics

abstract: Evaporation of multicomponent droplets is important in a wide range of applications, albeit complex, and requires a careful investigation. We experimentally and numerically investigate the evaporation characteristics of spherical, ethanol-water droplets with different initial concentration ratios in the acoustic levitation field. Imaging techniques and infrared thermometry are used for acquiring volume and surface temperature variations of droplets, reflecting their mass and heat transfer characteristics. Numerical simulations are conducted using modified parameters based on a theoretical model to consider the effect of the acoustic field. The calculation results show good agreement with the experimental data. The concentration and temperature distribution within the droplet is further investigated based on the numerical results.


title: Structural Knowledge-Driven Meta-Learning for Task Offloading in Vehicular Networks with Integrated Communications, Sensing and Computing

abstract: Task offloading is a potential solution to satisfy the strict requirements of computation-intensive and latency-sensitive vehicular applications due to the limited onboard computing resources. However, the overwhelming upload traffic may lead to unacceptable uploading time. To tackle this issue, for tasks taking environmental data as input, the data perceived by roadside units (RSU) equipped with several sensors can be directly exploited for computation, resulting in a novel task offloading paradigm with integrated communications, sensing and computing (I-CSC). With this paradigm, vehicles can select to upload their sensed data to RSUs or transmit computing instructions to RSUs during the offloading. By optimizing the computation mode and network resources, in this paper, we investigate an I-CSC-based task offloading problem to reduce the cost caused by resource consumption while guaranteeing the latency of each task. Although this non-convex problem can be handled by the alternating minimization (AM) algorithm that alternatively minimizes the divided four sub-problems, it leads to high computational complexity and local optimal solution. To tackle this challenge, we propose a creative structural knowledge-driven meta-learning (SKDML) method, involving both the model-based AM algorithm and neural networks. Specifically, borrowing the iterative structure of the AM algorithm, also referred to as structural knowledge, the proposed SKDML adopts long short-term memory (LSTM) network-based meta-learning to learn an adaptive optimizer for updating variables in each sub-problem, instead of the handcrafted counterpart in the AM algorithm.


title: Increasing stability for the inverse source problems in electrodynamics

abstract: We are concerned with increasing stability in the inverse source problems for the time-dependent Maxwell equations in R^3 , where the source term is compactly supported in both time and spatial variables. By using the Fourier transform, sharp bounds of the analytic continuation and the Huygens principle, increasing stability estimates of the L^2 -norm of the source function are obtained. The main goal of this paper is to understand increasing stability for the Maxwell equations in the time domain.


title: Towards Mixed Reality as the Everyday Computing Paradigm: Challenges & Design Recommendations

abstract: This research presents a proof-of-concept prototype of an all-in-one mixed reality application platform, developed to investigate the needs and expectations of users from mixed reality systems. The study involved an extensive user study with 1,052 participants, including the collection of diaries from 6 users and conducting interviews with 15 participants to gain deeper insights into their experiences. The findings from the interviews revealed that directly porting current user flows into 3D environments was not well-received by the target users. Instead, users expressed a clear preference for alternative 3D interactions along with the continued use of 2D interfaces. This study provides insights for understanding user preferences and interactions in mixed reality systems, and design recommendations to facilitate the mass adoption of MR systems.


title: Nonlinear photodetector based on InSe p-n homojunction for improving spatial imaging resolution

abstract: We demonstrate an efficient nonlinear photodetector (NLPD) with quadratic response based on a few-layer InSe p-n homojunction, which is beneficial from the strong second harmonic generation (SHG) process in InSe and effective harvest of photocarriers actuated by the high-quality homojunction. The NLPD can sense light with photon energy smaller than InSe electronic bandgap because the SHG process in InSe doubles the frequency of incident light, extending InSe photodetection wavelength range to 1750 nm. The InSe p-n homojunction, which is electrostatically doped by two split back gates, presents a rectification ratio exceeding 106 with a dark current down to 2 pA and a high normalized responsivity of 0.534 A/W2 for the telecom-band pulsed light at 1550 nm. The photocurrents of the SHG-assisted photodetection have a quadratic dependence on the optical powers, making the NLPD highly sensitive to light intensity variation with improved spatial resolution. As examples, the NLPD is employed to precisely determine the localization point of a focused laser beam waist and implement spatial imaging with an improved resolution compared with the linear photodetector. These features highlight the potential of the proposed NLPD in developing advanced optical sensing and imaging systems.


title: Increasing stability in the n-dimensional inverse source problem with multi-frequencies

abstract: In this paper, we show for the first time the increasing stability of the inverse source problem for the n-dimensional Helmholtz equation at multiple wave numbers, which is different from the two-or three-dimensional Helmholtz equation. In addition, we develop a new, unified approach to study increasing stability in any dimension. The method is based on the Fourier transform and explicit bounds for analytic continuation.


title: An Image Enhancement Method for Improving Small Intestinal Villi Clarity

abstract: This paper presents, for the first time, an image enhancement methodology designed to enhance the clarity of small intestinal villi in Wireless Capsule Endoscopy (WCE) images. This method first separates the low-frequency and high-frequency components of small intestinal villi images using guided filtering. Subsequently, an adaptive light gain factor is generated based on the low-frequency component, and an adaptive gradient gain factor is derived from the convolution results of the Laplacian operator in different regions of small intestinal villi images. The obtained light gain factor and gradient gain factor are then combined to enhance the high-frequency components. Finally, the enhanced high-frequency component is fused with the original image to achieve adaptive sharpening of the edges of WCE small intestinal villi images. The experiments affirm that, compared to established WCE image enhancement methods, our approach not only accentuates the edge details of WCE small intestine villi images but also skillfully suppresses noise amplification, thereby preventing the occurrence of edge overshooting.


title: Shaving Weights with Occam's Razor: Bayesian Sparsification for Neural Networks Using the Marginal Likelihood

abstract: Neural network sparsification is a promising avenue to save computational time and memory costs, especially in an age where many successful AI models are becoming too large to na\"ively deploy on consumer hardware. While much work has focused on different weight pruning criteria, the overall sparsifiability of the network, i.e., its capacity to be pruned without quality loss, has often been overlooked. We present Sparsifiability via the Marginal likelihood (SpaM), a pruning framework that highlights the effectiveness of using the Bayesian marginal likelihood in conjunction with sparsity-inducing priors for making neural networks more sparsifiable. Our approach implements an automatic Occam's razor that selects the most sparsifiable model that still explains the data well, both for structured and unstructured sparsification. In addition, we demonstrate that the pre-computed posterior Hessian approximation used in the Laplace approximation can be re-used to define a cheap pruning criterion, which outperforms many existing (more expensive) approaches. We demonstrate the effectiveness of our framework, especially at high sparsity levels, across a range of different neural network architectures and datasets.


title: Trace formula and Levinson's theorem as an index pairing in the presence of resonances

abstract: We realise the number of bound states of a Schr\"{o}dinger operator on $\mathbb{R}^n$ as an index pairing in all dimensions. Expanding on ideas of Guillop\'{e} and others, we use high-energy corrections to find representatives of the $K$-theory class of the scattering operator. These representatives allow us to compute the number of bound states using an integral formula involving heat kernel coefficients.


title: Signed Graph Representation Learning: A Survey

abstract: With the prevalence of social media, the connectedness between people has been greatly enhanced. Real-world relations between users on social media are often not limited to expressing positive ties such as friendship, trust, and agreement, but they also reflect negative ties such as enmity, mistrust, and disagreement, which can be well modelled by signed graphs. Signed Graph Representation Learning (SGRL) is an effective approach to analyze the complex patterns in real-world signed graphs with the co-existence of positive and negative links. In recent years, SGRL has witnesses fruitful results. SGRL tries to allocate low-dimensional representations to nodes and edges which could preserve the graph structure, attribute and some collective properties, e.g., balance theory and status theory. To the best of knowledge, there is no survey paper about SGRL up to now. In this paper, we present a broad review of SGRL methods and discuss some future research directions.


title: Improved Limits on $n \rightarrow n'$ Transformation from the Spallation Neutron Source

abstract: Conversions between neutrons $n$ and Dark Matter candidate sterile neutrons $n'$ have been proposed as a mechanism for Baryon Number $\mathcal{B}$ violation. In the case that there is a small mass difference $\Delta{m}$ between the $n$ and the $n'$ states, oscillations can be induced by compensating for $\Delta{m}$ with a magnetic field. A search for such neutron oscillations was performed at the Spallation Neutron Source by looking for anomalous neutron transmission through a strongly absorbing cadmium wafer inside of a $6.6$~T magnet. The approach described here saw no regenerated neutrons above background, which provides an improved limit for neutron - sterile neutrons transformations for a range of $\Delta{m}$ between $0.1$~neV and $1000$~neV.