title: Machine Learning-powered Compact Modeling of Stochastic Electronic Devices using Mixture Density Networks

abstract: The relentless pursuit of miniaturization and performance enhancement in electronic devices has led to a fundamental challenge in the field of circuit design and simulation: how to accurately account for the inherent stochastic nature of certain devices. While conventional deterministic models have served as indispensable tools for circuit designers, they fall short when it comes to capture the subtle yet critical variability exhibited by many electronic components. In this paper, we present an innovative approach that transcends the limitations of traditional modeling techniques by harnessing the power of machine learning, specifically Mixture Density Networks (MDNs), to faithfully represent and simulate the stochastic behavior of electronic devices. We demonstrate our approach to model heater cryotrons, where the model is able to capture the stochastic switching dynamics observed in the experiment. Our model shows 0.82% mean absolute error for switching probability. This paper marks a significant step forward in the quest for accurate and versatile compact models, poised to drive innovation in the realm of electronic circuits.


title: Let's Reinforce Step by Step

abstract: While recent advances have boosted LM proficiency in linguistic benchmarks, LMs consistently struggle to reason correctly on complex tasks like mathematics. We turn to Reinforcement Learning from Human Feedback (RLHF) as a method with which to shape model reasoning processes. In particular, we explore two reward schemes, outcome-supervised reward models (ORMs) and process-supervised reward models (PRMs), to optimize for logical reasoning. Our results show that the fine-grained reward provided by PRM-based methods enhances accuracy on simple mathematical reasoning (GSM8K) while, unexpectedly, reducing performance in complex tasks (MATH). Furthermore, we show the critical role reward aggregation functions play in model performance. Providing promising avenues for future research, our study underscores the need for further exploration into fine-grained reward modeling for more reliable language models.


title: Optimal taxation and the Domar-Musgrave effect

abstract: This article concerns the optimal choice of flat taxes on labor and capital income, and on consumption, in a tractable economic model. Agents manage a portfolio of bonds and physical capital while subject to idiosyncratic investment risk and random mortality. We identify the tax rates which maximize welfare in stationary equilibrium while preserving tax revenue, finding that a very large increase in welfare can be achieved by only taxing capital income and consumption. The optimal rate of capital income taxation is zero if the natural borrowing constraint is strictly binding on entrepreneurs, but may otherwise be positive and potentially large. The Domar-Musgrave effect, whereby capital income taxation with full offset provisions encourages risky investment through loss sharing, explains cases where it is optimal to tax capital income. In further analysis we study the dynamic response to the substitution of consumption taxation for labor income taxation. We find that consumption immediately drops before rising rapidly to the new stationary equilibrium, which is higher on average than initial consumption for workers but lower for entrepreneurs.


title: Recurrent Dynamic Message Passing with Loops for Epidemics on Networks

abstract: Several theoretical methods have been developed to approximate prevalence and threshold of epidemics on networks. Among them, the recurrent dynamic message-passing (rDMP) theory offers a state-of-the-art performance by preventing the echo chamber effect in network edges. However, the rDMP theory was derived in an intuitive ad-hoc way, lacking a solid theoretical foundation and resulting in a probabilistic inconsistency flaw. Furthermore, real-world networks are clustered and full of local loops like triangles, whereas rDMP is based on the assumption of a locally tree-like network structure, which makes rDMP potentially inefficient on real applications. In this work, for the recurrent-state epidemics, we first demonstrate that the echo chamber effect exits not only in edges but also in local loops, which rDMP-like method can not avoid. We then correct the deficiency of rDMP in a principled manner, leading to the natural introduction of new higher-order dynamic messages, extending rDMP to handle local loops. By linearizing the extended message-passing equations, a new epidemic threshold estimation is given by the inverse of the leading eigenvalue of a matrix named triangular non-backtracking matrix. Numerical experiments conducted on synthetic and real-world networks to evaluate our method, the efficacy of which is validated in epidemic prevalence and threshold prediction tasks. In addition, our method has the potential to speed up the solution of the immunization, influence maximization, and robustness optimization problems in the networks.


title: Towards a systematic study of non-thermal leptogenesis from inflaton decays

abstract: This paper investigates non-thermal leptogenesis from inflaton decays in the minimal extension of the canonical type-I seesaw model, where a complex singlet scalar $\phi$ is introduced to generate the Majorana masses of right-handed neutrinos (RHNs) and to play the role of inflaton. First, we systematically study non-thermal leptogenesis with the least model dependence. We give a general classification of the parameter space and find four characteristic limits by carefully examining the interplay between inflaton decay into RHNs and the decay of RHNs into the standard-model particles. Three of the four limits are truly non-thermal, with a final efficiency larger than that of thermal leptogenesis. Two analytic estimates for these three limits are provided with working conditions to examine the validity. In particular, we find that the {\it strongly non-thermal RHNs} scenario occupies a large parameter space, including the oscillation-preferred $K$ range, and works well for a relatively-low reheating temperature $T^{}_{\rm RH} \geq 10^3~{\rm GeV}$, extending the lower bound on the RHN mass to $2\times 10^{7}~{\rm GeV}$. The lepton flavor effects are discussed. Second, we demonstrate that such a unified picture for inflation, neutrino masses, and baryon number asymmetry can be realized by either a Coleman-Weinberg potential (for the real part of $\phi$) or a natural inflation potential (for the imaginary part of $\phi$). The allowed parameter ranges for successful inflation and non-thermal leptogenesis are much more constrained than those without inflationary observations. We find that non-thermal leptogenesis from inflaton decay offers a testable framework for the early Universe. It can be further tested with upcoming cosmological and neutrino data. The model-independent investigation of non-thermal leptogenesis should be useful in exploring this direction.


title: Entanglement Entropy due to the Presence of Static Quarks

abstract: We study the entanglement of gluon fields in presence of a static $Q\bar Q$ pair in quenched QCD. Using the replica method, we investigate the $q=2$ Renyi entropy of the entanglement of gluon fields inside and in the vicinity of the confining QCD string between the quark and the antiquark. We find that there is excess entropy of gluon entanglement compared to vacuum fluctuations. This excess of entanglement entropy is associated with the gluon flux tube, and we find that it has a finite non-zero value in the continuum. We investigate the dependence of gluon entanglement on the geometry of longitudinal and transverse partitioning of the flux tube. Our preliminary results suggest scaling of the entanglement entropy with the area of the boundary overlapping with the flux tube.


title: Honest Score Client Selection Scheme: Preventing Federated Learning Label Flipping Attacks in Non-IID Scenarios

abstract: Federated Learning (FL) is a promising technology that enables multiple actors to build a joint model without sharing their raw data. The distributed nature makes FL vulnerable to various poisoning attacks, including model poisoning attacks and data poisoning attacks. Today, many byzantine-resilient FL methods have been introduced to mitigate the model poisoning attack, while the effectiveness when defending against data poisoning attacks still remains unclear. In this paper, we focus on the most representative data poisoning attack - "label flipping attack" and monitor its effectiveness when attacking the existing FL methods. The results show that the existing FL methods perform similarly in Independent and identically distributed (IID) settings but fail to maintain the model robustness in Non-IID settings. To mitigate the weaknesses of existing FL methods in Non-IID scenarios, we introduce the Honest Score Client Selection (HSCS) scheme and the corresponding HSCSFL framework. In the HSCSFL, The server collects a clean dataset for evaluation. Under each iteration, the server collects the gradients from clients and then perform HSCS to select aggregation candidates. The server first evaluates the performance of each class of the global model and generates the corresponding risk vector to indicate which class could be potentially attacked. Similarly, the server evaluates the client's model and records the performance of each class as the accuracy vector. The dot product of each client's accuracy vector and global risk vector is generated as the client's host score; only the top p\% host score clients are included in the following aggregation. Finally, server aggregates the gradients and uses the outcome to update the global model. The comprehensive experimental results show our HSCSFL effectively enhances the FL robustness and defends against the "label flipping attack."


title: AccEPT: An Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training

abstract: It is usually infeasible to fit and train an entire large deep neural network (DNN) model using a single edge device due to the limited resources. To facilitate intelligent applications across edge devices, researchers have proposed partitioning a large model into several sub-models, and deploying each of them to a different edge device to collaboratively train a DNN model. However, the communication overhead caused by the large amount of data transmitted from one device to another during training, as well as the sub-optimal partition point due to the inaccurate latency prediction of computation at each edge device can significantly slow down training. In this paper, we propose AccEPT, an acceleration scheme for accelerating the edge collaborative pipeline-parallel training. In particular, we propose a light-weight adaptive latency predictor to accurately estimate the computation latency of each layer at different devices, which also adapts to unseen devices through continuous learning. Therefore, the proposed latency predictor leads to better model partitioning which balances the computation loads across participating devices. Moreover, we propose a bit-level computation-efficient data compression scheme to compress the data to be transmitted between devices during training. Our numerical results demonstrate that our proposed acceleration approach is able to significantly speed up edge pipeline parallel training up to 3 times faster in the considered experimental settings.


title: Diffusion Shape Prior for Wrinkle-Accurate Cloth Registration

abstract: Registering clothes from 4D scans with vertex-accurate correspondence is challenging, yet important for dynamic appearance modeling and physics parameter estimation from real-world data. However, previous methods either rely on texture information, which is not always reliable, or achieve only coarse-level alignment. In this work, we present a novel approach to enabling accurate surface registration of texture-less clothes with large deformation. Our key idea is to effectively leverage a shape prior learned from pre-captured clothing using diffusion models. We also propose a multi-stage guidance scheme based on learned functional maps, which stabilizes registration for large-scale deformation even when they vary significantly from training data. Using high-fidelity real captured clothes, our experiments show that the proposed approach based on diffusion models generalizes better than surface registration with VAE or PCA-based priors, outperforming both optimization-based and learning-based non-rigid registration methods for both interpolation and extrapolation tests.


title: Modeling the Morphology of Fast Radio Bursts and Radio Pulsars with fitburst

abstract: We present a framework for modeling astrophysical pulses from radio pulsars and fast radio bursts (FRBs). This framework, called fitburst, generates synthetic representations of dynamic spectra that are functions of several physical and heuristic parameters; the heuristic parameters can nonetheless accommodate a vast range of distributions in spectral energy. fitburst is designed to optimize the modeling of features induced by effects that are intrinsic and extrinsic to the emission mechanism, including the magnitude and frequency dependence of pulse dispersion and scatter-broadening. fitburst removes intra-channel smearing through two-dimensional upsampling, and can account for phase wrapping of "folded" signals that are typically acquired during pulsar-timing observations. We demonstrate the effectiveness of fitburst in modeling data containing pulsars and FRBs observed with the Canadian Hydrogen Intensity Mapping Experiment (CHIME) telescope.


title: The Sobol' sequence is not quasi-uniform in dimension 2

abstract: Are common quasi-Monte Carlo sequences quasi-uniform? While this question remains widely open, in this short note, we prove that the two-dimensional Sobol' sequence is not quasi-uniform. This result partially answers an unsolved problem of Sobol' and Shukhman (2007) in a negative manner.


title: Robust Constant-Time Cryptography

abstract: The constant-time property is considered the security standard for cryptographic code. Code following the constant-time discipline is free from secret-dependent branches and memory accesses, and thus avoids leaking secrets through cache and timing side-channels. The constant-time property makes a number of implicit assumptions that are fundamentally at odds with the reality of cryptographic code. Constant-time is not robust. The first issue with constant-time is that it is a whole-program property: It relies on the entirety of the code base being constant-time. But, cryptographic developers do not generally write whole programs; rather, they provide libraries and specific algorithms for other application developers to use. As such, developers of security libraries must maintain their security guarantees even when their code is operating within (potentially untrusted) application contexts. Constant-time requires memory safety. The whole-program nature of constant-time also leads to a second issue: constant-time requires memory safety of all the running code. Any memory safety bugs, whether in the library or the application, will wend their way back to side-channel leaks of secrets if not direct disclosure. And although cryptographic libraries should (and are) written to be memory-safe, it is unfortunately unrealistic to expect the same from every application that uses each library. We formalize robust constant-time and build a RobustIsoCrypt compiler that transforms the library code and protects the secrets even when they are linked with untrusted code. Our evaluation with SUPERCOP benchmarking framework shows that the performance overhead is less than five percent on average.


title: Dynamically cold disks in the early Universe: myth or reality?

abstract: Theoretical models struggle to reproduce dynamically cold disks with significant rotation-to-dispersion support($V_{\rm{rot}}/\sigma$) observed in star-forming galaxies in the early Universe, at redshift $z>4$. We aim to explore the possible emergence of dynamically cold disks in cosmological simulations and to understand if different kinematic tracers can help reconcile the tension between theory and observations. We use 3218 galaxies from the SERRA suite of zoom-in simulations, with $8<\log(M_*/M_{\odot})<10.3$ and SFR$<128\,M_{\odot}{yr}^{-1}$, within $4<z<9$ range. We generate hyper-spectral data cubes for 6436 synthetic observations of H$\alpha$ and [CII]. We find that the choice of kinematic tracer strongly influences gas velocity dispersion estimates. When using H$\alpha$ ([CII]) synthetic observations, we observe a strong (mild) correlation between $\sigma$ and $M_*$. Such a difference arises mostly for $M_*>10^9\,M_{\odot}$ galaxies, for which $\sigma_{H\alpha}>2\sigma_{CII}$ for a significant fraction of the sample. Regardless of the tracer, our predictions suggest the existence of massive ($M_*>10^{10}M_{\odot}$) galaxies with $V_{rot}/\sigma>10$ at $z>4$, maintaining cold disks for >10 orbital periods (200Myr). Furthermore, we do not find any significant redshift dependence for $V_{rot}/\sigma$ ratio in our sample. Our simulations predict the existence of dynamically cold disks in the early Universe. However, different tracers are sensitive to different kinematic properties. While [CII] effectively traces the thin, gaseous disk of galaxies, H$\alpha$ includes the contribution from ionized gas beyond the disk, characterized by prevalent vertical or radial motions that may be associated with outflows. The presence of H$\alpha$ halos could be a signature of such galactic outflows. This emphasizes the importance of combining ALMA and JWST/NIRspec studies of high-z galaxies.


title: Room-temperature ferromagnetism in epitaxial bilayer FeSb/SrTiO3(001) terminated with a Kagome lattice

abstract: Two-dimensional (2D) magnets exhibit unique physical properties for potential applications in spintronics. To date, most 2D ferromagnets are obtained by mechanical exfoliation of bulk materials with van der Waals interlayer interactions, and the synthesis of single or few-layer 2D ferromagnets with strong interlayer coupling remains experimentally challenging. Here, we report the epitaxial growth of 2D non-van der Waals ferromagnetic bilayer FeSb on SrTiO3(001) substrates stabilized by strong coupling to the substrate, which exhibits in-plane magnetic anisotropy and a Curie temperature above 300 K. In-situ low-temperature scanning tunneling microscopy/spectroscopy and density-functional theory calculations further reveal that a Fe Kagome layer terminates the bilayer FeSb. Our results open a new avenue for further exploring emergent quantum phenomena from the interplay of ferromagnetism and topology for application in spintronics.


title: An upper bound of the Hausdorff dimension of singular vectors on affine subspaces

abstract: In Diophantine approximation, the notion of singular vectors was introduced by Khintchine in the 1920's. We study the set of singular vectors on an affine subspace of $\mathbb{R}^n$. We give an upper bound of its Hausdorff dimension in terms of the Diophantine exponent of the parameter of the affine subspace.


title: Interior $C^2$ estimate for Hessian quotient equation in dimension three

abstract: In this paper, we establish an interior $C^2$ estimate for the Hessian quotient equation $\left(\frac{\sigma_3}{\sigma_1}\right)(D^2u)=f$ in dimension three. A crucial ingredient in our proof is a Jacobi inequality.


title: UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical Neural Radiance Fields

abstract: In the field of clinical medicine, computed tomography (CT) is an effective medical imaging modality for the diagnosis of various pathologies. Compared with X-ray images, CT images can provide more information, including multi-planar slices and three-dimensional structures for clinical diagnosis. However, CT imaging requires patients to be exposed to large doses of ionizing radiation for a long time, which may cause irreversible physical harm. In this paper, we propose an Uncertainty-aware MedNeRF (UMedNeRF) network based on generated radiation fields. The network can learn a continuous representation of CT projections from 2D X-ray images by obtaining the internal structure and depth information and using adaptive loss weights to ensure the quality of the generated images. Our model is trained on publicly available knee and chest datasets, and we show the results of CT projection rendering with a single X-ray and compare our method with other methods based on generated radiation fields.


title: High-efficiency edge couplers enabled by vertically tapering on lithium-niobate photonic chips

abstract: In the past decade, photonic integrated circuits (PICs) based on thin-film lithium niobate (TFLN) have advanced in various fields, including optical communication, nonlinear photonics, and quantum optics. A critical component is an efficient edge coupler connecting PICs to light sources or detectors. Here, we propose an innovative edge coupler design with a wedge-shaped TFLN waveguide and a silicon oxynitride (SiON) cladding. Experimental results show that the coupling loss between the TFLN PIC and a 3-{\mu}m mode field diameter (MFD) lensed fiber is low at 1.52 dB/facet, with the potential for improvement to 0.43 dB/facet theoretically. The coupling loss between the edge coupler and a UHNA7 fiber with an MFD of 3.2 {\mu}m is reduced to 0.92 dB/facet. This design maintains robust fabrication and alignment tolerance. Importantly, the minimum linewidth of the TFLN waveguide of the coupler (600 nm) can be easily achieved using foundry-available i-line stepper lithography. This work benefits the development of TFLN integrated platforms, such as on-chip electro-optic modulators, frequency comb generation, and quantum sensors.


title: Towards Interpretable Motion-level Skill Assessment in Robotic Surgery

abstract: Purpose: We study the relationship between surgical gestures and motion primitives in dry-lab surgical exercises towards a deeper understanding of surgical activity at fine-grained levels and interpretable feedback in skill assessment. Methods: We analyze the motion primitive sequences of gestures in the JIGSAWS dataset and identify inverse motion primitives in those sequences. Inverse motion primitives are defined as sequential actions on the same object by the same tool that effectively negate each other. We also examine the correlation between surgical skills (measured by GRS scores) and the number and total durations of inverse motion primitives in the dry-lab trials of Suturing, Needle Passing, and Knot Tying tasks. Results: We find that the sequence of motion primitives used to perform gestures can help detect labeling errors in surgical gestures. Inverse motion primitives are often used as recovery actions to correct the position or orientation of objects or may be indicative of other issues such as with depth perception. The number and total durations of inverse motion primitives in trials are also strongly correlated with lower GRS scores in the Suturing and Knot Tying tasks. Conclusion: The sequence and pattern of motion primitives could be used to provide interpretable feedback in surgical skill assessment. Combined with an action recognition model, the explainability of automated skill assessment can be improved by showing video clips of the inverse motion primitives of inefficient or problematic movements.


title: Visualizing symmetry-breaking electronic orders in epitaxial Kagome magnet FeSn films

abstract: Kagome lattice hosts a plethora of quantum states arising from the interplay of topology, spin-orbit coupling, and electron correlations. Here, we report symmetry-breaking electronic orders tunable by an applied magnetic field in a model Kagome magnet FeSn consisting of alternating stacks of two-dimensional Fe3Sn Kagome and Sn2 honeycomb layers. On the Fe3Sn layer terminated FeSn thin films epitaxially grown on SrTiO3(111) substrates, we observe trimerization of the Kagome lattice using scanning tunneling microscopy/spectroscopy, breaking its six-fold rotational symmetry while preserving the transitional symmetry. Such a trimerized Kagome lattice shows an energy-dependent contrast reversal in dI/dV maps, which is significantly enhanced by bound states induced by Sn vacancy defects. This trimerized Kagome lattice also exhibits stripe modulations that are energy-dependent and tunable by an applied in-plane magnetic field, indicating symmetry-breaking nematicity from the entangled magnetic and charge degrees of freedom in antiferromagnet FeSn.


title: Predictive AI for SME and Large Enterprise Financial Performance Management

abstract: Financial performance management is at the core of business management and has historically relied on financial ratio analysis using Balance Sheet and Income Statement data to assess company performance as compared with competitors. Little progress has been made in predicting how a company will perform or in assessing the risks (probabilities) of financial underperformance. In this study I introduce a new set of financial and macroeconomic ratios that supplement standard ratios of Balance Sheet and Income Statement. I also provide a set of supervised learning models (ML Regressors and Neural Networks) and Bayesian models to predict company performance. I conclude that the new proposed variables improve model accuracy when used in tandem with standard industry ratios. I also conclude that Feedforward Neural Networks (FNN) are simpler to implement and perform best across 6 predictive tasks (ROA, ROE, Net Margin, Op Margin, Cash Ratio and Op Cash Generation); although Bayesian Networks (BN) can outperform FNN under very specific conditions. BNs have the additional benefit of providing a probability density function in addition to the predicted (expected) value. The study findings have significant potential helping CFOs and CEOs assess risks of financial underperformance to steer companies in more profitable directions; supporting lenders in better assessing the condition of a company and providing investors with tools to dissect financial statements of public companies more accurately.


title: Quasi-Gramian Solution of a Noncommutative Extension of the Higher-Order Nonlinear Schr\"odinger Equation

abstract: The nonlinear Schr{\"o}odinger (NLS) equation, which incorporates higher-order dispersive terms, is widely employed in the theoretical analysis of various physical phenomena. In this study, we explore the non-commutative extension of the higher-order NLS equation (HNLS). We treat real or complex-valued functions, such as g1 = g1(x, t) and g2 = g2(x, t), as non-commutative, and employ the Lax pair associated with the evolution equation as in the commutation case. We derive the quasi-Gramian solution of the system by employing a binary Darboux transformation (DT). Moreover, the solution can be used to study the stability of plane waves and to understand the generation of periodic patterns in the context of modulational instability.


title: AI-native Interconnect Framework for Integration of Large Language Model Technologies in 6G Systems

abstract: The evolution towards 6G architecture promises a transformative shift in communication networks, with artificial intelligence (AI) playing a pivotal role. This paper delves deep into the seamless integration of Large Language Models (LLMs) and Generalized Pretrained Transformers (GPT) within 6G systems. Their ability to grasp intent, strategize, and execute intricate commands will be pivotal in redefining network functionalities and interactions. Central to this is the AI Interconnect framework, intricately woven to facilitate AI-centric operations within the network. Building on the continuously evolving current state-of-the-art, we present a new architectural perspective for the upcoming generation of mobile networks. Here, LLMs and GPTs will collaboratively take center stage alongside traditional pre-generative AI and machine learning (ML) algorithms. This union promises a novel confluence of the old and new, melding tried-and-tested methods with transformative AI technologies. Along with providing a conceptual overview of this evolution, we delve into the nuances of practical applications arising from such an integration. Through this paper, we envisage a symbiotic integration where AI becomes the cornerstone of the next-generation communication paradigm, offering insights into the structural and functional facets of an AI-native 6G network.


title: TacIPC: Intersection- and Inversion-free FEM-based Elastomer Simulation For Optical Tactile Sensors

abstract: Tactile perception stands as a critical sensory modality for human interaction with the environment. Among various tactile sensor techniques, optical sensor-based approaches have gained traction, notably for producing high-resolution tactile images. This work explores gel elastomer deformation simulation through a physics-based approach. While previous works in this direction usually adopt the explicit material point method (MPM), which has certain limitations in force simulation and rendering, we adopt the finite element method (FEM) and address the challenges in penetration and mesh distortion with incremental potential contact (IPC) method. As a result, we present a simulator named TacIPC, which can ensure numerically stable simulations while accommodating direct rendering and friction modeling. To evaluate TacIPC, we conduct three tasks: pseudo-image quality assessment, deformed geometry estimation, and marker displacement prediction. These tasks show its superior efficacy in reducing the sim-to-real gap. Our method can also seamlessly integrate with existing simulators. More experiments and videos can be found in the supplementary materials and on the website: https://sites.google.com/view/tac-ipc.


title: Face-StyleSpeech: Improved Face-to-Voice latent mapping for Natural Zero-shot Speech Synthesis from a Face Image

abstract: Generating a voice from a face image is crucial for developing virtual humans capable of interacting using their unique voices, without relying on pre-recorded human speech. In this paper, we propose Face-StyleSpeech, a zero-shot Text-To-Speech (TTS) synthesis model that generates natural speech conditioned on a face image rather than reference speech. We hypothesize that learning both speaker identity and prosody from a face image poses a significant challenge. To address the issue, our TTS model incorporates both a face encoder and a prosody encoder. The prosody encoder is specifically designed to model prosodic features that are not captured only with a face image, allowing the face encoder to focus solely on capturing the speaker identity from the face image. Experimental results demonstrate that Face-StyleSpeech effectively generates more natural speech from a face image than baselines, even for the face images the model has not trained. Samples are at our demo page https://face-stylespeech.github.io.


title: Tamil-Llama: A New Tamil Language Model Based on Llama 2

abstract: Language modeling has witnessed remarkable advancements in recent years, with Large Language Models (LLMs) like ChatGPT setting unparalleled benchmarks in human-like text generation. However, a prevailing limitation is the underrepresentation of languages like Tamil in these cutting-edge models, leading to suboptimal performance in diverse linguistic contexts. This paper addresses this lacuna, enhancing the open-source LLaMA model with an addition of 16,000 Tamil tokens, aiming to achieve superior text generation and comprehension in the Tamil language. We strategically employ the LoRA methodology for efficient model training on a comprehensive Tamil corpus, ensuring computational feasibility and model robustness. Moreover, we introduce a Tamil-translated version of the Alpaca dataset and a subset of the OpenOrca dataset tailored for instruction fine-tuning. Our results showcase significant performance improvements in Tamil text generation, with potential implications for the broader landscape of LLMs in Indian languages. We further underscore our commitment to open research by making our models, datasets, and code publicly accessible, fostering further innovations in language modeling.


title: Clipped-Objective Policy Gradients for Pessimistic Policy Optimization

abstract: To facilitate efficient learning, policy gradient approaches to deep reinforcement learning (RL) are typically paired with variance reduction measures and strategies for making large but safe policy changes based on a batch of experiences. Natural policy gradient methods, including Trust Region Policy Optimization (TRPO), seek to produce monotonic improvement through bounded changes in policy outputs. Proximal Policy Optimization (PPO) is a commonly used, first-order algorithm that instead uses loss clipping to take multiple safe optimization steps per batch of data, replacing the bound on the single step of TRPO with regularization on multiple steps. In this work, we find that the performance of PPO, when applied to continuous action spaces, may be consistently improved through a simple change in objective. Instead of the importance sampling objective of PPO, we instead recommend a basic policy gradient, clipped in an equivalent fashion. While both objectives produce biased gradient estimates with respect to the RL objective, they also both display significantly reduced variance compared to the unbiased off-policy policy gradient. Additionally, we show that (1) the clipped-objective policy gradient (COPG) objective is on average "pessimistic" compared to both the PPO objective and (2) this pessimism promotes enhanced exploration. As a result, we empirically observe that COPG produces improved learning compared to PPO in single-task, constrained, and multi-task learning, without adding significant computational cost or complexity. Compared to TRPO, the COPG approach is seen to offer comparable or superior performance, while retaining the simplicity of a first-order method.


title: Threshold distribution of equal states for quantitative amplitude fluctuations

abstract: Objective. The distribution of equal states (DES) quantifies amplitude fluctuations in biomedical signals. However, under certain conditions, such as a high resolution of data collection or special signal processing techniques, equal states may be very rare, whereupon the DES fails to measure the amplitude fluctuations. Approach. To address this problem, we develop a novel threshold DES (tDES) that measures the distribution of differential states within a threshold. To evaluate the proposed tDES, we first analyze five sets of synthetic signals generated in different frequency bands. We then analyze sleep electroencephalography (EEG) datasets taken from the public PhysioNet. Main results. Synthetic signals and detrend-filtered sleep EEGs have no neighboring equal values; however, tDES can effectively measure the amplitude fluctuations within these data. The tDES of EEG data increases significantly as the sleep stage increases, even with datasets covering very short periods, indicating decreased amplitude fluctuations in sleep EEGs. Generally speaking, the presence of more low-frequency components in a physiological series reflects smaller amplitude fluctuations and larger DES. Significance.The tDES provides a reliable computing method for quantifying amplitude fluctuations, exhibiting the characteristics of conceptual simplicity and computational robustness. Our findings broaden the application of quantitative amplitude fluctuations and contribute to the classification of sleep stages based on EEG data.


title: Emulating power spectra for pre- and post-reconstructed galaxy samples

abstract: The small-scale linear information in galaxy samples typically lost during non-linear growth can be restored to a certain level by the density field reconstruction, which has been demonstrated for improving the precision of the baryon acoustic oscillations (BAO) measurements. As proposed in the literature, a joint analysis of the power spectrum before and after the reconstruction enables an efficient extraction of information carried by high-order statistics. However, the statistics of the post-reconstruction density field are difficult to model. In this work, we circumvent this issue by developing an accurate emulator for the pre-reconstructed, post-reconstructed, and cross power spectra ($P_{\rm pre}$, $P_{\rm post}$, $P_{\rm cross}$) up to $k=0.5~h~{\rm Mpc^{-1}}$ based on the \textsc{Dark Quest} N-body simulations. The accuracy of the emulator is at percent level, namely, the error of the emulated monopole and quadrupole of the power spectra is less than $1\%$ and $10\%$ of the ground truth, respectively. A fit to an example power spectra using the emulator shows that the constraints on cosmological parameters get largely improved using $P_{\rm pre}$+$P_{\rm post}$+$P_{\rm cross}$ with $k_{\rm max}=0.25~h~{\rm Mpc^{-1}}$, compared to that derived from $P_{\rm pre}$ alone, namely, the constraints on ($\Omega_m$, $H_0$, $\sigma_8$) are tightened by $\sim41 \%-55\%$, and the uncertainties of the derived BAO and RSD parameters ($\alpha_{\perp}$, $\alpha_{||}$, $f\sigma_8$) shrink by $\sim 28\%-54\%$, respectively. This highlights the complementarity among $P_{\rm pre}$, $P_{\rm post}$ and $P_{\rm cross}$, which demonstrates the efficiency and practicability of a joint $P_{\rm pre}$, $P_{\rm post}$ and $P_{\rm cross}$ analysis for cosmological implications.


title: Strict Rezk completions of models of HoTT and homotopy canonicity

abstract: We give a new constructive proof of homotopy canonicity for homotopy type theory (HoTT). Canonicity proofs typically involve gluing constructions over the syntax of type theory. We instead use a gluing construction over a "strict Rezk completion" of the syntax of HoTT. The strict Rezk completion is specified and constructed in the topos of cartesian cubical sets. It completes a model of HoTT to an equivalent model satisfying a saturation condition, providing an equivalence between terms of identity types and cubical paths between terms. This generalizes the ordinary Rezk completion of a 1-category.


title: Exploring Fine-tuning ChatGPT for News Recommendation

abstract: News recommendation systems (RS) play a pivotal role in the current digital age, shaping how individuals access and engage with information. The fusion of natural language processing (NLP) and RS, spurred by the rise of large language models such as the GPT and T5 series, blurs the boundaries between these domains, making a tendency to treat RS as a language task. ChatGPT, renowned for its user-friendly interface and increasing popularity, has become a prominent choice for a wide range of NLP tasks. While previous studies have explored ChatGPT on recommendation tasks, this study breaks new ground by investigating its fine-tuning capability, particularly within the news domain. In this study, we design two distinct prompts: one designed to treat news RS as the ranking task and another tailored for the rating task. We evaluate ChatGPT's performance in news recommendation by eliciting direct responses through the formulation of these two tasks. More importantly, we unravel the pivotal role of fine-tuning data quality in enhancing ChatGPT's personalized recommendation capabilities, and illustrates its potential in addressing the longstanding challenge of the "cold item" problem in RS. Our experiments, conducted using the Microsoft News dataset (MIND), reveal significant improvements achieved by ChatGPT after fine-tuning, especially in scenarios where a user's topic interests remain consistent, treating news RS as a ranking task. This study illuminates the transformative potential of fine-tuning ChatGPT as a means to advance news RS, offering more effective news consumption experiences.


title: Cognitive Architecture Toward Common Ground Sharing Among Humans and Generative AIs: Trial on Model-Model Interactions in Tangram Naming Task

abstract: For generative AIs to be trustworthy, establishing transparent common grounding with humans is essential. As a preparation toward human-model common grounding, this study examines the process of model-model common grounding. In this context, common ground is defined as a cognitive framework shared among agents in communication, enabling the connection of symbols exchanged between agents to the meanings inherent in each agent. This connection is facilitated by a shared cognitive framework among the agents involved. In this research, we focus on the tangram naming task (TNT) as a testbed to examine the common-ground-building process. Unlike previous models designed for this task, our approach employs generative AIs to visualize the internal processes of the model. In this task, the sender constructs a metaphorical image of an abstract figure within the model and generates a detailed description based on this image. The receiver interprets the generated description from the partner by constructing another image and reconstructing the original abstract figure. Preliminary results from the study show an improvement in task performance beyond the chance level, indicating the effect of the common cognitive framework implemented in the models. Additionally, we observed that incremental backpropagations leveraging successful communication cases for a component of the model led to a statistically significant increase in performance. These results provide valuable insights into the mechanisms of common grounding made by generative AIs, improving human communication with the evolving intelligent machines in our future society.


title: Exchange stiffness proportional to power of magnetization in permalloy co-doped with Mo and Cu

abstract: The exchange stiffness of magnetic materials is one of the essential parameters governing magnetic texture and its dynamics in magnetic devices. The effect of single-element doping on exchange stiffness has been investigated for several doping elements for permalloy (NiFe alloy), a soft magnetic material whose soft magnetic properties can be controlled by doping. However, the impact of more practical multi-element doping on the exchange stiffness of permalloy is unknown. This study investigates the typical magnetic properties, including exchange stiffness, of permalloy systematically co-doped with Mo and Cu using broadband ferromagnetic resonance spectroscopy. We find that the exchange stiffness, which decreases with increasing doping levels, is proportional to a power of magnetization, which also decreases with increasing doping levels. The magnetization, $M_{\rm s}$, dependence of the exchange stiffness constant, $A$, of all the investigated samples, irrespective of the doping levels of each element, lies on a single curve expressed as $A\propto M_{\rm s}^n$ with exponent $n$ close to 2. This empirical power-law relationship provides a guideline for predicting unknown exchange stiffness in non-magnetic element-doped permalloy systems.


title: Reframing Audience Expansion through the Lens of Probability Density Estimation

abstract: Audience expansion has become an important element of prospective marketing, helping marketers create target audiences based on a mere representative sample of their current customer base. Within the realm of machine learning, a favored algorithm for scaling this sample into a broader audience hinges on a binary classification task, with class probability estimates playing a crucial role. In this paper, we review this technique and introduce a key change in how we choose training examples to ensure the quality of the generated audience. We present a simulation study based on the widely used MNIST dataset, where consistent high precision and recall values demonstrate our approach's ability to identify the most relevant users for an expanded audience. Our results are easily reproducible and a Python implementation is openly available on GitHub: \url{https://github.com/carvalhaes-ai/audience-expansion}


title: Sol-gel synthesis and multiferroic properties of pyrochlore-free Pb(Fe0.5Nb0.5)O3 thin films

abstract: Lead iron niobate (PbFe0.5Nb0.5O3 - PFN) thin films were synthesized by a modified sol-gel route, which offers the advantage of a rapid, simple and non-toxic reaction method. Polycrystalline perovskite-structured PFN thin films without pyrochlore phases were obtained on Pt/Ti/SiO2/Si substrates after sintering by rapid thermal annealing at 650 {\deg}C. TEM and AFM images confirmed the excellent quality of the sintered film, while EDS spectroscopy revealed the presence of oxygen vacancies near the film/substrate interface. Electric measurements show good dielectric properties and ferroelectric behavior, characterized by typical C-V curves and well-defined P-E ferroelectric loops at 1 kHz, with remanent polarization values of ~12 uC/cm2. The polarization, however, increases with decreasing frequency, indicating the presence of leakage currents. I-V measurements show a significant increase in DC-conduction at relatively low fields (around 100 kV/cm). The films display ferromagnetic behavior at room temperature, with magnetic remanence around 30 emu/cm3 and a coercive field of 1 kOe. These values are significantly higher than those obtained for PFN powders fabricated by the same sol-gel route, as well as the magnetization values reported in the literature for epitaxial films.


title: Enhancement of optical absorption in multiferroic (1-x)PZT-xPFN thin films: Experiments and first-principles analysis

abstract: Multiferroic compounds have gained research attention in the field of ferroelectric photovoltaics due to the presence of transition-metal d states from magnetic ions, which tend to reduce the bandgap value. In this work, 0.5Pb(Zr0.52Ti0.48)O3 - 0.5Pb(Fe0.5Nb0.5)O3 PZTFN0.5 thin films were synthesized using a sol-gel route to investigate the effect of iron doping on optical and multiferroic properties. For comparative analysis, the end-member compositions, Pb(Zr0.52Ti0.48)O3 (PZT) and Pb(Fe0.5Nb0.5)O3 (PFN), were also synthesized under identical conditions. Our results revealed that the presence of Fe ions, besides inducing multiferroic behavior, effectively enhances the optical absorption of the material in the visible light region. Optical transitions at 3.0 eV (2.4 eV) and 2.7 eV (2.2 eV) for the direct (indirect) bandgap were determined for PZTFN0.5 and PFN, respectively, indicating that the absorption edges of the iron-containing films result more promising than PZT (Eg 3.6eV) for photovoltaic applications. Both PZTFN0.5 and PFN thin films exhibit multiferroic behavior at room temperature, with different electric and magnetic properties. While PZTFN0.5 presents saturated hysteresis loops with remanent polarization values around 10 uC/cm2 and magnetization of 1.6 emu/cm2, PFN displays significantly larger remanence (31 emu/cm2) but poorer ferroelectric properties due to the presence of leakage. Microscopic insights into the structural and electronic properties of the PZTFN0.5 solid solution were provided from first-principles calculations.


title: Vortex-Antivortex Lattices in a Holographic Superconductor

abstract: We employ the Einstein-Abelian-Higgs theory to investigate the structure of vortex-antivortex lattices within a superconductor driven by spatial periodic magnetic fields. By adjusting the parameters of the external magnetic field, including the period ($\mathcal{T}$) and the amplitude ($B_0$), various distinct vortex states emerge. These states encompass the Wigner crystallization state, the vortex cluster state, and the suppressed state. Additionally, we present a comprehensive phase diagram to demarcate the specific regions where these structures emerge, contributing to our understanding of superconductivity in complex magnetic environments.


title: On the Design and Analysis of Parallel and Distributed Algorithms

abstract: Arrival of multicore systems has enforced a new scenario in computing, the parallel and distributed algorithms are fast replacing the older sequential algorithms, with many challenges of these techniques. The distributed algorithms provide distributed processing using distributed file systems and processing units, while network is modeled as minimum cost spanning tree. On the other hand, the parallel processing chooses different language platforms, data parallel vs. parallel programming, and GPUs. Processing units, memory elements and storage are connected through dynamic distributed networks in the form of spanning trees. The article presents foundational algorithms, analysis, and efficiency considerations.


title: Layer-wise Auto-Weighting for Non-Stationary Test-Time Adaptation

abstract: Given the inevitability of domain shifts during inference in real-world applications, test-time adaptation (TTA) is essential for model adaptation after deployment. However, the real-world scenario of continuously changing target distributions presents challenges including catastrophic forgetting and error accumulation. Existing TTA methods for non-stationary domain shifts, while effective, incur excessive computational load, making them impractical for on-device settings. In this paper, we introduce a layer-wise auto-weighting algorithm for continual and gradual TTA that autonomously identifies layers for preservation or concentrated adaptation. By leveraging the Fisher Information Matrix (FIM), we first design the learning weight to selectively focus on layers associated with log-likelihood changes while preserving unrelated ones. Then, we further propose an exponential min-max scaler to make certain layers nearly frozen while mitigating outliers. This minimizes forgetting and error accumulation, leading to efficient adaptation to non-stationary target distribution. Experiments on CIFAR-10C, CIFAR-100C, and ImageNet-C show our method outperforms conventional continual and gradual TTA approaches while significantly reducing computational load, highlighting the importance of FIM-based learning weight in adapting to continuously or gradually shifting target domains.


title: Softly Broken Hidden Symmetry in Every Renormalizable Field Theory

abstract: It is pointed out that every renormalizable field theory has a symmetry which is hidden in plain sight. In all practical cases, it is also broken softly, either explicitly or spontaneously. Implications for neutrino mass and dark matter are discussed.


title: $\mathcal{O}\left(m\alpha^2 (Z\alpha)^6\right)$ contribution to Lamb shift from radiative corrections to the Wichmann-Kroll potential

abstract: We derive an analytical expression for the contribution of the order $m\alpha^2 (Z\alpha)^6$ to the hydrogen Lamb shift which comes from the diagrams for radiative corrections to the Wichmann-Kroll potential. We use modern methods of multiloop calculations, based on IBP reduction, DRA method and differential equations.


title: Domain Generalization by Learning from Privileged Medical Imaging Information

abstract: Learning the ability to generalize knowledge between similar contexts is particularly important in medical imaging as data distributions can shift substantially from one hospital to another, or even from one machine to another. To strengthen generalization, most state-of-the-art techniques inject knowledge of the data distribution shifts by enforcing constraints on learned features or regularizing parameters. We offer an alternative approach: Learning from Privileged Medical Imaging Information (LPMII). We show that using some privileged information such as tumor shape or location leads to stronger domain generalization ability than current state-of-the-art techniques. This paper demonstrates that by using privileged information to predict the severity of intra-layer retinal fluid in optical coherence tomography scans, the classification accuracy of a deep learning model operating on out-of-distribution data improves from $0.911$ to $0.934$. This paper provides a strong starting point for using privileged information in other medical problems requiring generalization.


title: Emergence and reconfiguration of modular structure for synaptic neural networks during continual familiarity detection

abstract: While advances in artificial intelligence and neuroscience have enabled the emergence of neural networks capable of learning a wide variety of tasks, our understanding of the temporal dynamics of these networks remains limited. Here, we study the temporal dynamics during learning of Hebbian Feedforward (HebbFF) neural networks in tasks of continual familiarity detection. Drawing inspiration from the field of network neuroscience, we examine the network's dynamic reconfiguration, focusing on how network modules evolve throughout learning. Through a comprehensive assessment involving metrics like network accuracy, modular flexibility, and distribution entropy across diverse learning modes, our approach reveals various previously unknown patterns of network reconfiguration. In particular, we find that the emergence of network modularity is a salient predictor of performance, and that modularization strengthens with increasing flexibility throughout learning. These insights not only elucidate the nuanced interplay of network modularity, accuracy, and learning dynamics but also bridge our understanding of learning in artificial and biological realms.


title: Watermarking Vision-Language Pre-trained Models for Multi-modal Embedding as a Service

abstract: Recent advances in vision-language pre-trained models (VLPs) have significantly increased visual understanding and cross-modal analysis capabilities. Companies have emerged to provide multi-modal Embedding as a Service (EaaS) based on VLPs (e.g., CLIP-based VLPs), which cost a large amount of training data and resources for high-performance service. However, existing studies indicate that EaaS is vulnerable to model extraction attacks that induce great loss for the owners of VLPs. Protecting the intellectual property and commercial ownership of VLPs is increasingly crucial yet challenging. A major solution of watermarking model for EaaS implants a backdoor in the model by inserting verifiable trigger embeddings into texts, but it is only applicable for large language models and is unrealistic due to data and model privacy. In this paper, we propose a safe and robust backdoor-based embedding watermarking method for VLPs called VLPMarker. VLPMarker utilizes embedding orthogonal transformation to effectively inject triggers into the VLPs without interfering with the model parameters, which achieves high-quality copyright verification and minimal impact on model performance. To enhance the watermark robustness, we further propose a collaborative copyright verification strategy based on both backdoor trigger and embedding distribution, enhancing resilience against various attacks. We increase the watermark practicality via an out-of-distribution trigger selection approach, removing access to the model training data and thus making it possible for many real-world scenarios. Our extensive experiments on various datasets indicate that the proposed watermarking approach is effective and safe for verifying the copyright of VLPs for multi-modal EaaS and robust against model extraction attacks. Our code is available at https://github.com/Pter61/vlpmarker.


title: DPR: An Algorithm Mitigate Bias Accumulation in Recommendation feedback loops

abstract: Recommendation models trained on the user feedback collected from deployed recommendation systems are commonly biased. User feedback is considerably affected by the exposure mechanism, as users only provide feedback on the items exposed to them and passively ignore the unexposed items, thus producing numerous false negative samples. Inevitably, biases caused by such user feedback are inherited by new models and amplified via feedback loops. Moreover, the presence of false negative samples makes negative sampling difficult and introduces spurious information in the user preference modeling process of the model. Recent work has investigated the negative impact of feedback loops and unknown exposure mechanisms on recommendation quality and user experience, essentially treating them as independent factors and ignoring their cross-effects. To address these issues, we deeply analyze the data exposure mechanism from the perspective of data iteration and feedback loops with the Missing Not At Random (\textbf{MNAR}) assumption, theoretically demonstrating the existence of an available stabilization factor in the transformation of the exposure mechanism under the feedback loops. We further propose Dynamic Personalized Ranking (\textbf{DPR}), an unbiased algorithm that uses dynamic re-weighting to mitigate the cross-effects of exposure mechanisms and feedback loops without additional information. Furthermore, we design a plugin named Universal Anti-False Negative (\textbf{UFN}) to mitigate the negative impact of the false negative problem. We demonstrate theoretically that our approach mitigates the negative effects of feedback loops and unknown exposure mechanisms. Experimental results on real-world datasets demonstrate that models using DPR can better handle bias accumulation and the universality of UFN in mainstream loss methods.


title: A study for the energy structure of the Mott system with a low-energy excitation, in terms of the pseudo-gap in HTSC

abstract: The Mott system with a low-energy excitation may well constitute the underlying system for high temperature superconductivity (HTSC) of under-doped cuprates. This manuscript explores the above through the Hubbard-1 approximation (the Green function method), especially in terms of its self-energy while evaluating the calculation of self-energy using effective mass ratio. Results show it appears the pseudo-gap of HTSC is due to the self-energy effect on the quasi-particle excitation of the Mott's J.


title: Fair Supervised Learning with A Simple Random Sampler of Sensitive Attributes

abstract: As the data-driven decision process becomes dominating for industrial applications, fairness-aware machine learning arouses great attention in various areas. This work proposes fairness penalties learned by neural networks with a simple random sampler of sensitive attributes for non-discriminatory supervised learning. In contrast to many existing works that critically rely on the discreteness of sensitive attributes and response variables, the proposed penalty is able to handle versatile formats of the sensitive attributes, so it is more extensively applicable in practice than many existing algorithms. This penalty enables us to build a computationally efficient group-level in-processing fairness-aware training framework. Empirical evidence shows that our framework enjoys better utility and fairness measures on popular benchmark data sets than competing methods. We also theoretically characterize estimation errors and loss of utility of the proposed neural-penalized risk minimization problem.


title: PodReels: Human-AI Co-Creation of Video Podcast Teasers

abstract: Video podcast teasers are short videos that can be shared on social media platforms to capture interest in the full episodes of a video podcast. These teasers enable long-form podcasters to reach new audiences and gain new followers. However, creating a compelling teaser from an hour-long episode is challenging. Selecting interesting clips requires significant mental effort; editing the chosen clips into a cohesive, well-produced teaser is time-consuming. To support the creation of video podcast teasers, we first investigate what makes a good teaser. We combine insights from both audience comments and creator interviews to determine a set of essential ingredients. We also identify a common workflow shared by creators during the process. Based on these findings, we introduce a human-AI co-creative tool called PodReels to assist video podcasters in creating teasers. Our user study shows that PodReels significantly reduces creators' mental demand and improves their efficiency in producing video podcast teasers.


title: Observation of the out-of-plane orbital antidamping-like torque

abstract: The out-of-plane antidamping-like orbital torque fosters great hope for high-efficiency spintronic devices. Here we report experimentally the observation of out-of-plane antidamping-like torque that could be generated by z-polarized orbital current in ferromagnetic-metal/oxidized Cu bilayers, which is presented unambiguously by the magnetic field angle dependence of spin-torque ferromagnetic resonance signal. The oxidized Cu thickness dependence of orbital torque ratios highlights the interfacial effect would be responsible for the generation of orbital current. Besides that, the oxidized Cu thickness dependence of damping parameter further proves the observation of antidamping-like torque. This result contributes to enriching the orbital-related theory of the generation mechanism of the orbital torque.


title: One-shot data-driven design of fractional-order PID controller considering closed-loop stability: fictitious reference signal approach

abstract: A one-shot data-driven tuning method for a fractional-order proportional-integral-derivative (FOPID) controller is proposed. The proposed method tunes the FOPID controller in the model-reference control formulation. A loss function is defined to evaluate the match between a given reference model and the closed-loop response while explicitly considering the closed-loop stability. A loss function value is based on the fictitious reference signal computed using the input/output data. Model matching is achieved via loss function minimization. The proposed method is simple and practical: it needs only one-shot input/output data of a plant (no plant model required), considers the bounded-input bounded-output stability of the closed-loop system, and automatically determines the appropriate parameter value via optimization. Numerical simulations show that the proposed approach facilitates good control performance, and destabilization can be avoided even if perfect model matching is unachievable.


title: Automated Heterogeneous Low-Bit Quantization of Multi-Model Deep Learning Inference Pipeline

abstract: Multiple Deep Neural Networks (DNNs) integrated into single Deep Learning (DL) inference pipelines e.g. Multi-Task Learning (MTL) or Ensemble Learning (EL), etc., albeit very accurate, pose challenges for edge deployment. In these systems, models vary in their quantization tolerance and resource demands, requiring meticulous tuning for accuracy-latency balance. This paper introduces an automated heterogeneous quantization approach for DL inference pipelines with multiple DNNs.


title: Exact WKB analysis for adiabatic discrete-level Hamiltonians

abstract: The dynamics of quantum systems under the adiabatic Hamiltonian has attracted attention not only in quantum control but also in a wide range of fields from condensed matter physics to high-energy physics because of its non-perturbative behavior. Here we analyze the adiabatic dynamics in the two-level systems and the multilevel systems using the exact WKB analysis, which is one of the non-perturbative analysis methods. As a result, we obtain a formula for the transition probability, which is similar to the known formula in the two-level system. Although non-perturbative analysis in the adiabatic limit has rarely been studied for multilevel systems, we show that the same analysis can be applied and also provide a concrete example. The results will serve as a basis for the application of the exact WKB analysis in various fields of physics.


title: $\mathbb{Z}_2$ classification of FTR symmetric differential operators and obstruction to Anderson localization

abstract: This paper concerns the $\mathbb{Z}_2$ classification of Fermionic Time-Reversal (FTR) symmetric partial differential Hamiltonians on the Euclidean plane. We consider the setting of two insulators separated by an interface. Hamiltonians that are invariant with respect to spatial translations along the interface are classified into two categories depending on whether they may or may not be gapped by continuous deformations. Introducing a related odd-symmetric Fredholm operator, we show that the classification is stable against FTR-symmetric perturbations. The property that non-trivial Hamiltonians cannot be gapped may be interpreted as a topological obstruction to Anderson localization: no matter how much (spatially compactly supported) perturbations are present in the system, a certain amount of transmission in both directions is guaranteed in the nontrivial phase. We present a scattering theory for such systems and show numerically that transmission is indeed guaranteed in the presence of FTR-symmetric perturbations while it no longer is for non-symmetric fluctuations.


title: Provably Trainable Rotationally Equivariant Quantum Machine Learning

abstract: Exploiting the power of quantum computation to realise superior machine learning algorithmshas been a major research focus of recent years, but the prospects of quantum machine learning (QML) remain dampened by considerable technical challenges. A particularly significant issue is that generic QML models suffer from so-called barren plateaus in their training landscapes -- large regions where cost function gradients vanish exponentially in the number of qubits employed, rendering large models effectively untrainable. A leading strategy for combating this effect is to build problem-specific models which take into account the symmetries of their data in order to focus on a smaller, relevant subset of Hilbert space. In this work, we introduce a family of rotationally equivariant QML models built upon the quantum Fourier transform, and leverage recent insights from the Lie-algebraic study of QML models to prove that (a subset of) our models do not exhibit barren plateaus. In addition to our analytical results we numerically test our rotationally equivariant models on a dataset of simulated scanning tunnelling microscope images of phosphorus impurities in silicon, where rotational symmetry naturally arises, and find that they dramatically outperform their generic counterparts in practice.


title: Testing Dependency of Unlabeled Databases

abstract: In this paper, we investigate the problem of deciding whether two random databases $\mathsf{X}\in\mathcal{X}^{n\times d}$ and $\mathsf{Y}\in\mathcal{Y}^{n\times d}$ are statistically dependent or not. This is formulated as a hypothesis testing problem, where under the null hypothesis, these two databases are statistically independent, while under the alternative, there exists an unknown row permutation $\sigma$, such that $\mathsf{X}$ and $\mathsf{Y}^\sigma$, a permuted version of $\mathsf{Y}$, are statistically dependent with some known joint distribution, but have the same marginal distributions as the null. We characterize the thresholds at which optimal testing is information-theoretically impossible and possible, as a function of $n$, $d$, and some spectral properties of the generative distributions of the datasets. For example, we prove that if a certain function of the eigenvalues of the likelihood function and $d$, is below a certain threshold, as $d\to\infty$, then weak detection (performing slightly better than random guessing) is statistically impossible, no matter what the value of $n$ is. This mimics the performance of an efficient test that thresholds a centered version of the log-likelihood function of the observed matrices. We also analyze the case where $d$ is fixed, for which we derive strong (vanishing error) and weak detection lower and upper bounds.


title: A 76 minute gamma-ray periodicity in Sagittarius A*

abstract: Using publicly available gamma-ray observations of Saggitarius A* (Sgr A*), we constructed its ~6 months (from 2022 June 22 to 2022 December 19) light curve and subsequently we built its associated periodogram to search for a clear periodical signal. The lightcurve was constructed using the Fermitools package from observations of the Fermi satellite. The associated periodogram was built using the R-package RobPer algorithm, through a two-step model-fitting procedure employing the unweighted tau-regression method. To reduce the likelihood of false positive detections, we incorporated a Window Function method into our analysis. We identify a clear significant peak on the periodogram at 76.32 minutes. The found periodicity is consistent with two other works in the literature at different wavelengths, supporting the idea of a unique oscillatory physical mechanism.


title: Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications

abstract: Large language models (LLMs) exhibit superior performance on various natural language tasks, but they are susceptible to issues stemming from outdated data and domain-specific limitations. In order to address these challenges, researchers have pursued two primary strategies, knowledge editing and retrieval augmentation, to enhance LLMs by incorporating external information from different aspects. Nevertheless, there is still a notable absence of a comprehensive survey. In this paper, we propose a review to discuss the trends in integration of knowledge and large language models, including taxonomy of methods, benchmarks, and applications. In addition, we conduct an in-depth analysis of different methods and point out potential research directions in the future. We hope this survey offers the community quick access and a comprehensive overview of this research area, with the intention of inspiring future research endeavors.


title: A Performance-Driven Benchmark for Feature Selection in Tabular Deep Learning

abstract: Academic tabular benchmarks often contain small sets of curated features. In contrast, data scientists typically collect as many features as possible into their datasets, and even engineer new features from existing ones. To prevent overfitting in subsequent downstream modeling, practitioners commonly use automated feature selection methods that identify a reduced subset of informative features. Existing benchmarks for tabular feature selection consider classical downstream models, toy synthetic datasets, or do not evaluate feature selectors on the basis of downstream performance. Motivated by the increasing popularity of tabular deep learning, we construct a challenging feature selection benchmark evaluated on downstream neural networks including transformers, using real datasets and multiple methods for generating extraneous features. We also propose an input-gradient-based analogue of Lasso for neural networks that outperforms classical feature selection methods on challenging problems such as selecting from corrupted or second-order features.


title: Central Angle Optimization for 360-degree Holographic 3D Content

abstract: In this study, we propose a method to find an optimal central angle in deep learning-based depth map estimation used to produce realistic holographic content. The acquisition of RGB-depth map images as detailed as possible must be performed to generate holograms of high quality, despite the high computational cost. Therefore, we introduce a novel pipeline designed to analyze various values of central angles between adjacent camera viewpoints equidistant from the origin of an object-centered environment. Then we propose the optimal central angle to generate high-quality holographic content. The proposed pipeline comprises key steps such as comparing estimated depth maps and comparing reconstructed CGHs (Computer-Generated Holograms) from RGB images and estimated depth maps. We experimentally demonstrate and discuss the relationship between the central angle and the quality of digital holographic content.


title: Relative Higher Homology and Representation Theory

abstract: Higher homological algebra, basically done in the framework of an $n$-cluster tilting subcategory $\mathcal{M}$ of an abelian category $\mathcal{A}$, has been the topic of several recent researches. In this paper, we study a relative version, in the sense of Auslander-Solberg, of the higher homological algebra. To this end, we consider an additive sub-bifunctor $F$ of $\mathrm{Ext}^n_{\mathcal{M}}( -,-)$ as the basis of our relative theory. This, in turn, specifies a collection of $n$-exact sequences in $\mathcal{M}$, which allows us to delve into the relative higher homological algebra. Our results include a proof of the relative $n$-Auslander-Reiten duality formula, as well as an exploration of relative Grothendieck groups, among other results. As an application, we provide necessary and sufficient conditions for $\mathcal{M}$ to be of finite type.


title: High-order bounds-satisfying approximation of partial differential equations via finite element variational inequalities

abstract: Solutions to many important partial differential equations satisfy bounds constraints, but approximations computed by finite element or finite difference methods typically fail to respect the same conditions. Chang and Nakshatrala enforce such bounds in finite element methods through the solution of variational inequalities rather than linear variational problems. Here, we provide a theoretical justification for this method, including higher-order discretizations. We prove an abstract best approximation result for the linear variational inequality and estimates showing that bounds-constrained polynomials provide comparable approximation power to standard spaces. For any unconstrained approximation to a function, there exists a constrained approximation which is comparable in the $W^{1,p}$ norm. In practice, one cannot efficiently represent and manipulate the entire family of bounds-constrained polynomials, but applying bounds constraints to the coefficients of a polynomial in the Bernstein basis guarantees those constraints on the polynomial. Although our theoretical results do not guaruntee high accuracy for this subset of bounds-constrained polynomials, numerical results indicate optimal orders of accuracy for smooth solutions and sharp resolution of features in convection-diffusion problems, all subject to bounds constraints.


title: Programmable Superconducting Optoelectronic Single-Photon Synapses with Integrated Multi-State Memory

abstract: The co-location of memory and processing is a core principle of neuromorphic computing. A local memory device for synaptic weight storage has long been recognized as an enabling element for large-scale, high-performance neuromorphic hardware. In this work, we demonstrate programmable superconducting synapses with integrated memories for use in superconducting optoelectronic neural systems. Superconducting nanowire single-photon detectors and Josephson junctions are combined into programmable synaptic circuits that exhibit single-photon sensitivity, memory cells with more than 400 internal states, leaky integration of input spike events, and 0.4 fJ programming energies (including cooling power). These results are attractive for implementing a variety of supervised and unsupervised learning algorithms and lay the foundation for a new hardware platform optimized for large-scale spiking network accelerators.


title: Coevolutionary Dynamics of Group Interactions: Coevolving Nonlinear Voter Models

abstract: We survey the coevolutionary dynamics of network topology and group interactions in opinion formation, grounded on a coevolving nonlinear voter model. The coevolving nonlinear voter model incorporates two mechanisms: group interactions implemented through nonlinearity in the voter model and network plasticity demonstrated as the rewiring of links to remove connections between nodes in different opinions. We show that the role of group interactions, implemented by the nonlinearity can significantly impact both the dynamical outcomes of nodes' state and the network topology. Additionally, we review several variants of the coevolving nonlinear voter model considering different rewiring mechanisms, noise of flipping nodes' state, and multilayer structures. We portray the various aspects of the coevolving nonlinear voter model as an example of network coevolution driven by group interactions, and finally, present the implications and potential directions for future research.


title: Time-Varying Identification of Monetary Policy Shocks

abstract: We propose a new Bayesian heteroskedastic Markov-switching structural vector autoregression with data-driven time-varying identification. The model selects alternative exclusion restrictions over time and, as a condition for the search, allows to verify identification through heteroskedasticity within each regime. Based on four alternative monetary policy rules, we show that a monthly six-variable system supports time variation in US monetary policy shock identification. In the sample-dominating first regime, systematic monetary policy follows a Taylor rule extended by the term spread, effectively curbing inflation. In the second regime, occurring after 2000 and gaining more persistence after the global financial and COVID crises, it is characterized by a money-augmented Taylor rule. This regime's unconventional monetary policy provides economic stimulus, features the liquidity effect, and is complemented by a pure term spread shock. Absent the specific monetary policy of the second regime, inflation would be over one percentage point higher on average after 2008.


title: Hiformer: Heterogeneous Feature Interactions Learning with Transformers for Recommender Systems

abstract: Learning feature interaction is the critical backbone to building recommender systems. In web-scale applications, learning feature interaction is extremely challenging due to the sparse and large input feature space; meanwhile, manually crafting effective feature interactions is infeasible because of the exponential solution space. We propose to leverage a Transformer-based architecture with attention layers to automatically capture feature interactions. Transformer architectures have witnessed great success in many domains, such as natural language processing and computer vision. However, there has not been much adoption of Transformer architecture for feature interaction modeling in industry. We aim at closing the gap. We identify two key challenges for applying the vanilla Transformer architecture to web-scale recommender systems: (1) Transformer architecture fails to capture the heterogeneous feature interactions in the self-attention layer; (2) The serving latency of Transformer architecture might be too high to be deployed in web-scale recommender systems. We first propose a heterogeneous self-attention layer, which is a simple yet effective modification to the self-attention layer in Transformer, to take into account the heterogeneity of feature interactions. We then introduce \textsc{Hiformer} (\textbf{H}eterogeneous \textbf{I}nteraction Trans\textbf{former}) to further improve the model expressiveness. With low-rank approximation and model pruning, \hiformer enjoys fast inference for online deployment. Extensive offline experiment results corroborates the effectiveness and efficiency of the \textsc{Hiformer} model. We have successfully deployed the \textsc{Hiformer} model to a real world large scale App ranking model at Google Play, with significant improvement in key engagement metrics (up to +2.66\%).


title: Hadronic resonance production with ALICE at the LHC

abstract: Hadronic resonance production plays an important role both in elementary and in nucleus-nucleus collisions. In heavy-ion collisions, since the lifetimes of short-lived resonances are comparable with the lifetime of the late hadronic phase, regeneration and rescattering effects become important and ratios of yields of resonances relative to those of longer lived particles can be used to estimate the time interval between the chemical and kinetic freeze-out. The measurements in pp and p--Pb collisions constitute a reference for nuclear collisions and provide information for tuning event generators inspired by Quantum Chromodynamics.


title: Anisotropy of shear relaxation in primitive chain network simulations for entangled polymers confined between flat walls

abstract: Anisotropic shear relaxation is an interesting but rarely discussed issue in polymer dynamics under confinement [Abberton et al., Macromolecules, 48, 7631, 2015]. According to the earlier study of bead spring simulations for an unentangled polymer melt confined between two flat plates, the shear relaxation modulus taken perpendicular to the interface is accelerated by decreasing the distance between plates, whereas the parallel component is unchanged. This study observed similar anisotropic shear relaxation for entangled polymer melts under confinement in multi-chain slip-link simulations (primitive chain network simulations). The analysis demonstrated that the accelerated relaxation in the perpendicular component reflects the Rouse-type constraint release dynamics, for which the coarsening is upper-limited by the geometry. This result suggests a novel mechanism for anisotropic shear relaxation different from the modified chain statistics under confinement considered for unentangled systems.


title: A Practical Guide to Implementing Off-Axis Stereo Projection Using Existing Ray Tracing Libraries

abstract: Virtual reality (VR) renderers driving CAVEs and similar immersive environments use the off-axis stereo camera model so that a tracked user can move freely in front of the projection plane. Geometrically, off-axis projection results in asymmetric viewing frusta and generalizes the ubiquitous perspective camera model to support positioning off the center of the projection plane. VR renderers often integrate with larger visualization systems that rely on libraries for position tracking and pose estimates, for ray tracing-based rendering, and for user interaction. We demonstrate different strategies to implement off-axis stereo projection within the constraints of given VR applications and ray tracing libraries. We aim for minimal to no adjustments required to the internal camera representation of such libraries. We include host and shader code with the article that can be directly integrated in custom applications.


title: Low-Multi-Rank High-Order Bayesian Robust Tensor Factorization

abstract: The recently proposed tensor robust principal component analysis (TRPCA) methods based on tensor singular value decomposition (t-SVD) have achieved numerous successes in many fields. However, most of these methods are only applicable to third-order tensors, whereas the data obtained in practice are often of higher order, such as fourth-order color videos, fourth-order hyperspectral videos, and fifth-order light-field images. Additionally, in the t-SVD framework, the multi-rank of a tensor can describe more fine-grained low-rank structure in the tensor compared with the tubal rank. However, determining the multi-rank of a tensor is a much more difficult problem than determining the tubal rank. Moreover, most of the existing TRPCA methods do not explicitly model the noises except the sparse noise, which may compromise the accuracy of estimating the low-rank tensor. In this work, we propose a novel high-order TRPCA method, named as Low-Multi-rank High-order Bayesian Robust Tensor Factorization (LMH-BRTF), within the Bayesian framework. Specifically, we decompose the observed corrupted tensor into three parts, i.e., the low-rank component, the sparse component, and the noise component. By constructing a low-rank model for the low-rank component based on the order-$d$ t-SVD and introducing a proper prior for the model, LMH-BRTF can automatically determine the tensor multi-rank. Meanwhile, benefiting from the explicit modeling of both the sparse and noise components, the proposed method can leverage information from the noises more effectivly, leading to an improved performance of TRPCA. Then, an efficient variational inference algorithm is established for parameters estimation. Empirical studies on synthetic and real-world datasets demonstrate the effectiveness of the proposed method in terms of both qualitative and quantitative results.


title: Semantic Map Guided Synthesis of Wireless Capsule Endoscopy Images using Diffusion Models

abstract: Wireless capsule endoscopy (WCE) is a non-invasive method for visualizing the gastrointestinal (GI) tract, crucial for diagnosing GI tract diseases. However, interpreting WCE results can be time-consuming and tiring. Existing studies have employed deep neural networks (DNNs) for automatic GI tract lesion detection, but acquiring sufficient training examples, particularly due to privacy concerns, remains a challenge. Public WCE databases lack diversity and quantity. To address this, we propose a novel approach leveraging generative models, specifically the diffusion model (DM), for generating diverse WCE images. Our model incorporates semantic map resulted from visualization scale (VS) engine, enhancing the controllability and diversity of generated images. We evaluate our approach using visual inspection and visual Turing tests, demonstrating its effectiveness in generating realistic and diverse WCE images.


title: Improved bounds on the Product Rank of the Permanent

abstract: We unify Ryser's and Glynn's formulas for computing the permanent into a single framework. We then show via an orbital bound argument that the product rank of the permanent is asymptotically upper bounded by $ \frac{\exp\left(\pi\sqrt{\frac{2n}{3}}\right)}{4\sqrt{3}n} $.


title: Essential difference between 2D and 3D from the perspective of real-space renormalization group

abstract: We point out that area laws of quantum-information concepts indicate limitations of block transformations as well-behaved real-space renormalization group (RG) maps, which in turn guides the design of better RG schemes. Mutual-information area laws imply the difficulty of Kadanoff's block-spin method in two dimensions (2D) or higher due to the growth of short-scale correlations among the spins on the boundary of a block. A leap to the tensor-network RG, in hindsight, follows the guidance of mutual information and is efficient in 2D, thanks to its mixture of quantum and classical perspectives and the saturation of entanglement entropy in 2D. In three dimensions (3D), however, entanglement grows according to the area law, posing a threat to 3D block-tensor map as an apt RG transformation. As a numerical evidence, we show that estimations of 3D Ising critical exponents fail to improve by retaining more couplings. As a guidance to proceed, a tensor-network toy model is proposed to capture the 3D entanglement-entropy area law.

categories: cond-mat.stat-mech hep-th physics.comp-ph quant-ph


title: Structural Parameterizations of Vertex Integrity

abstract: The graph parameter vertex integrity measures how vulnerable a graph is to a removal of a small number of vertices. More precisely, a graph with small vertex integrity admits a small number of vertex removals to make the remaining connected components small. In this paper, we initiate a systematic study of structural parameterizations of the problem of computing the unweighted/weighted vertex integrity. As structural graph parameters, we consider well-known parameters such as clique-width, treewidth, pathwidth, treedepth, modular-width, neighborhood diversity, twin cover number, and cluster vertex deletion number. We show several positive and negative results and present sharp complexity contrasts.


title: Spatial distribution of reduced density of hard spheres near a hard-sphere dimer: Results from three-dimensional Ornstein-Zernike equations coupled with several different closures and from grand canonical Monte Carlo simulation

abstract: We calculated the spatial distribution of reduced density and pair distribution function (PDF) of solvent hard spheres near a solute using three-dimensional Ornstein-Zernike (OZ) equations coupled with closures in which Percus-Yevick (PY) and hypernetted-chain (HNC) approximations were employed or bridge functions (BFs) proposed by Verlet, Duh and Henderson, and Kinoshita were incorporated. The solute was formed by two solvent hard spheres in contact with each other, with the result that the system is not radial-symmetric, necessitating the extension of Verlet, Duh-Henderson, and Kinoshita BFs to three-variable functions considered in the Cartesian coordinate system. The results were compared with those from grand canonical Monte Carlo (MC) simulation. In terms of the PDF, HNC is superior to PY in the sense that the results from the former are closer to those from MC. The incorporation of the three BFs makes the results further closer to those from MC. The three BFs share almost the same performance for a solute immersed in a one-component solvent at the infinite-dilution limit. Analyses on the triplet distribution function (TDF) were also performed. It was found that in terms of the TDF the incorporation of the BFs does not necessarily lead to improvement.


title: Nucleon isovector form factors from domain-wall lattice QCD at the physical mass

abstract: The current status of lattice-QCD numerical calculations by joint LHP, RBC, and UKQCD collaborations of nucleon isovector vector- and axialvector-current form factors using a 2+1-flavor dynamical domain-wall fermions lattice QCD ensemble generated jointly by RBC and UKQCD collaborations are presented. The lattice spacing is set at about 0.1141(3) fm, and the lattice spatial extent is 48 spacings or about 5.4750(14) fm. The strange and degenerate up and down quark mass values are set at their essentially physical values to provide the physical $\Omega$ mass and a degenerate pion mass of 0.1392(2) GeV. Our nucleon mass estimate is about 0.947(6) GeV. Possible excited-state contaminations in the calculated vector- and axialvector-current form factors are hidden below larger statistical noises. The numerical details of the form-factor shape parameters, such as the mean squared radii, the anomalous magnetic moment, or the pseudoscalar coupling extracted from the form factors, are described, along with comparisons of different approaches used to extract them.


title: Orthogonality related to Steiner and Pappus chains

abstract: The focus of this paper is on the study of specific circle formations known as orthogonal Pappus chains and the related incidence results that involve points of tangency between the circles in the construction. These chains give rise to new circle families, with their centres on a conic. The paper also explores similar questions for Steiner chains, although it is demonstrated that orthogonality cannot be defined for them. Nonetheless, explicit examples are provided, exhibiting comparable incidence results and raising whether two Steiner chains that share a common circle in the chains possess this property.


title: Optimal Privacy-Aware Dynamic Estimation

abstract: In this paper, we develop an information-theoretic framework for the optimal privacy-aware estimation of the states of a (linear or nonlinear) system. In our setup, a private process, modeled as a first-order Markov chain, derives the states of the system, and the state estimates are shared with an untrusted party who might attempt to infer the private process based on the state estimates. As the privacy metric, we use the mutual information between the private process and the state estimates. We first show that the privacy-aware estimation is a closed-loop control problem wherein the estimator controls the belief of the adversary about the private process. We also derive the Bellman optimality principle for the optimal privacy-aware estimation problem, which is used to study the structural properties of the optimal estimator. We next develop a policy gradient algorithm, for computing an optimal estimation policy, based on a novel variational formulation of the mutual information. We finally study the performance of the optimal estimator in a building automation application.


title: Stability Problems on D-finite Functions

abstract: This paper continues the studies of symbolic integration by focusing on the stability problems on D-finite functions. We introduce the notion of stability index in order to investigate the order growth of the differential operators satisfied by iterated integrals of D-finite functions and determine bounds and exact formula for stability indices of several special classes of differential operators. With the basic properties of stability index, we completely solve the stability problem on general hyperexponential functions.


title: ERNIE: A Reactor Antineutrino Inverse Beta Decay Event Generator

abstract: We present ERNIE, a computer program which generates nuclear reactor electron antineutrinos and inverse beta decay events induced by these particles, using the Monte-Carlo method. The program allows the usage of different antineutrino energy spectra models and can simulate the time evolution of the overall antineutrino spectrum because of the burn-up effect. The output of the program can readily be used in detector simulations made with eg. GEANT 4.


title: Experimental perspectives on the matter-antimatter asymmetry puzzle: developments in electron EDM and antihydrogen experiments

abstract: In the search for clues to the matter-antimatter puzzle, experiments with atoms or molecules play a particular role. These systems allow measurements with very high precision, as demonstrated by the unprecedented limits down to $10^{-30}$ e.cm on electron EDM using molecular ions, and relative measurements at the level of $10^{-12}$ in spectroscopy of antihydrogen atoms. Building on these impressive measurements, new experimental directions offer potentials for drastic improvements. We review here some of the new perspectives in those fields and their associated prospects for new physics searches.


title: Diamond-shaped quantum circuit for real-time quantum dynamics in one dimension

abstract: In recent years, quantum computing has evolved as an exciting frontier, with the development of numerous algorithms dedicated to constructing quantum circuits that adeptly represent quantum many-body states. However, this domain remains in its early stages and requires further refinement to understand better the effective construction of highly-entangled quantum states within quantum circuits. Here, we demonstrate that quantum many-body states can be universally represented using a quantum circuit comprising multi-qubit gates. Furthermore, we evaluate the efficiency of a quantum circuit constructed with two-qubit gates in quench dynamics for the transverse-field Ising model. In this specific model, despite the initial state being classical without entanglement, it undergoes long-time evolution, eventually leading to a highly-entangled quantum state. Our results reveal that a diamond-shaped quantum circuit, designed to approximate the multi-qubit gate-based quantum circuit, remarkably excels in accurately representing the long-time dynamics of the system. Moreover, the diamond-shaped circuit follows the volume law behavior in entanglement entropy, offering a significant advantage over alternative quantum circuit constructions employing two-qubit gates.


title: Chromatic numbers for facet colouring of some generalized associahedra

abstract: The chromatic number of a proper colouring of the facets of certain classes of generalized associahedra is studied. The exact values are obtained for the permutohedron and the associahedron, while lower and upper bounds are established for the $n$-dimensional cyclohedron, astrohedron and simple permutoassociahedron.


title: Citation Recommendation on Scholarly Legal Articles

abstract: Citation recommendation is the task of finding appropriate citations based on a given piece of text. The proposed datasets for this task consist mainly of several scientific fields, lacking some core ones, such as law. Furthermore, citation recommendation is used within the legal domain to identify supporting arguments, utilizing non-scholarly legal articles. In order to alleviate the limitations of existing studies, we gather the first scholarly legal dataset for the task of citation recommendation. Also, we conduct experiments with state-of-the-art models and compare their performance on this dataset. The study suggests that, while BM25 is a strong benchmark for the legal citation recommendation task, the most effective method involves implementing a two-step process that entails pre-fetching with BM25+, followed by re-ranking with SciNCL, which enhances the performance of the baseline from 0.26 to 0.30 MAP@10. Moreover, fine-tuning leads to considerable performance increases in pre-trained models, which shows the importance of including legal articles in the training data of these models.


title: Establishing Performance Baselines in Fine-Tuning, Retrieval-Augmented Generation and Soft-Prompting for Non-Specialist LLM Users

abstract: Research into methods for improving the performance of large language models (LLMs) through fine-tuning, retrieval-augmented generation (RAG) and soft-prompting has tended to focus on the use of highly technical or high-cost techniques, making many of the newly discovered approaches comparatively inaccessible to non-technical users. In this paper we tested an unmodified version of GPT 3.5, a fine-tuned version, and the same unmodified model when given access to a vectorised RAG database, both in isolation and in combination with a basic, non-algorithmic soft prompt. In each case we tested the model's ability to answer a set of 100 questions relating primarily to events that occurred after September 2021 (the point at which GPT 3.5's training data set ends). We found that if commercial platforms are used and default settings are applied with no iteration in order to establish a baseline set of outputs, a fine-tuned model outperforms GPT 3.5 Turbo, while the RAG approach out-performed both. The application of a soft prompt significantly improved the performance of each approach.