title: Three-band extension for the Glashow-Weinberg-Salam model

abstract: By analogy with the Ginzburg-Landau theory of multi-band superconductors with inner (interband) Josephson couplings we formulate the three-band Glashow-Weinberg-Salam model with weak Josephson couplings between strongly asymmetrical condensates of scalar (Higgs) fields. Unlike usual single-band model, we found three Higgs bosons corresponding to three generations of particles, moreover the heaviest of them corresponds to the already discovered H-boson from the single-band theory and decay into fermions of only the third generation. The other two decay into fermions of the first and second generations accordingly, but they are difficult to observe due to very poor conditions for production. We found two sterile ultra-light Leggett bosons, the Bose condensates of which form the dark halos of galaxies and their clusters (i.e so called "dark matter"). The masses of the Leggett bosons are determined by the coefficient of the interband coupling and can be arbitrarily small ($\sim 10^{-20}\mathrm{eV}$) due to non-perturbativeness of the interband coupling. Since propagation of Leggett bosons is not accompanied by current, these bosons are not absorbed by gauge fields unlike the common-mode Goldstone bosons. Three coupled condensates of the scalar fields causes the existence of three generations of leptons, where each generation interacts with the corresponding condensate getting mass. The interflavour mixing between the generations of active neutrinos and sterile right-handed neutrinos in the three-band system causes the existence of mass states of neutrino without interaction with the Higgs condensates.


title: Cross-Modal Coordination Across a Diverse Set of Input Modalities

abstract: Cross-modal retrieval is the task of retrieving samples of a given modality by using queries of a different one. Due to the wide range of practical applications, the problem has been mainly focused on the vision and language case, e.g. text to image retrieval, where models like CLIP have proven effective in solving such tasks. The dominant approach to learning such coordinated representations consists of projecting them onto a common space where matching views stay close and those from non-matching pairs are pushed away from each other. Although this cross-modal coordination has been applied also to other pairwise combinations, extending it to an arbitrary number of diverse modalities is a problem that has not been fully explored in the literature. In this paper, we propose two different approaches to the problem. The first is based on an extension of the CLIP contrastive objective to an arbitrary number of input modalities, while the second departs from the contrastive formulation and tackles the coordination problem by regressing the cross-modal similarities towards a target that reflects two simple and intuitive constraints of the cross-modal retrieval task. We run experiments on two different datasets, over different combinations of input modalities and show that the approach is not only simple and effective but also allows for tackling the retrieval problem in novel ways. Besides capturing a more diverse set of pair-wise interactions, we show that we can use the learned representations to improve retrieval performance by combining the embeddings from two or more such modalities.


title: Improving the TENOR of Labeling: Re-evaluating Topic Models for Content Analysis

abstract: Topic models are a popular tool for understanding text collections, but their evaluation has been a point of contention. Automated evaluation metrics such as coherence are often used, however, their validity has been questioned for neural topic models (NTMs) and can overlook a models benefits in real world applications. To this end, we conduct the first evaluation of neural, supervised and classical topic models in an interactive task based setting. We combine topic models with a classifier and test their ability to help humans conduct content analysis and document annotation. From simulated, real user and expert pilot studies, the Contextual Neural Topic Model does the best on cluster evaluation metrics and human evaluations; however, LDA is competitive with two other NTMs under our simulated experiment and user study results, contrary to what coherence scores suggest. We show that current automated metrics do not provide a complete picture of topic modeling capabilities, but the right choice of NTMs can be better than classical models on practical task.


title: ConFit: Improving Resume-Job Matching using Data Augmentation and Contrastive Learning

abstract: A reliable resume-job matching system helps a company find suitable candidates from a pool of resumes, and helps a job seeker find relevant jobs from a list of job posts. However, since job seekers apply only to a few jobs, interaction records in resume-job datasets are sparse. Different from many prior work that use complex modeling techniques, we tackle this sparsity problem using data augmentations and a simple contrastive learning approach. ConFit first creates an augmented resume-job dataset by paraphrasing specific sections in a resume or a job post. Then, ConFit uses contrastive learning to further increase training samples from $B$ pairs per batch to $O(B^2)$ per batch. We evaluate ConFit on two real-world datasets and find it outperforms prior methods (including BM25 and OpenAI text-ada-002) by up to 19% and 31% absolute in nDCG@10 for ranking jobs and ranking resumes, respectively.


title: FedFair^3: Unlocking Threefold Fairness in Federated Learning

abstract: Federated Learning (FL) is an emerging paradigm in machine learning without exposing clients' raw data. In practical scenarios with numerous clients, encouraging fair and efficient client participation in federated learning is of utmost importance, which is also challenging given the heterogeneity in data distribution and device properties. Existing works have proposed different client-selection methods that consider fairness; however, they fail to select clients with high utilities while simultaneously achieving fair accuracy levels. In this paper, we propose a fair client-selection approach that unlocks threefold fairness in federated learning. In addition to having a fair client-selection strategy, we enforce an equitable number of rounds for client participation and ensure a fair accuracy distribution over the clients. The experimental results demonstrate that FedFair^3, in comparison to the state-of-the-art baselines, achieves 18.15% less accuracy variance on the IID data and 54.78% on the non-IID data, without decreasing the global accuracy. Furthermore, it shows 24.36% less wall-clock training time on average.


title: Sunyaev-Zeldovich signatures from non-thermal, relativistic electrons using CMB maps

abstract: Relativistically energetic, non-thermal population of electrons can give rise to unique CMB spectral distortion signatures which can be significantly different from thermal Sunyaev-Zeldovich signal or $y$-distortion. These signatures depend upon the spectrum of non-thermal electrons, therefore, a detection can inform us about the existence and abundance of non-thermal electrons in our universe. Using public CMB maps and data, we derive upper limits on non-thermal $y$-parameter for a relativistic, power-law electron distribution. With future CMB experiments, we may be in a position to detect or put significantly tighter constraints on these signals which can affect our understanding of non-thermal electron distributions in our universe.


title: Adversarial Training on Purification (AToP): Advancing Both Robustness and Generalization

abstract: The deep neural networks are known to be vulnerable to well-designed adversarial attacks. The most successful defense technique based on adversarial training (AT) can achieve optimal robustness against particular attacks but cannot generalize well to unseen attacks. Another effective defense technique based on adversarial purification (AP) can enhance generalization but cannot achieve optimal robustness. Meanwhile, both methods share one common limitation on the degraded standard accuracy. To mitigate these issues, we propose a novel pipeline to acquire the robust purifier model, named Adversarial Training on Purification (AToP), which comprises two components: perturbation destruction by random transforms (RT) and purifier model fine-tuned (FT) by adversarial loss. RT is essential to avoid overlearning to known attacks, resulting in the robustness generalization to unseen attacks, and FT is essential for the improvement of robustness. To evaluate our method in an efficient and scalable way, we conduct extensive experiments on CIFAR-10, CIFAR-100, and ImageNette to demonstrate that our method achieves optimal robustness and exhibits generalization ability against unseen attacks.


title: Empirical and Theoretical Analysis of Liquid Staking Protocols

abstract: Liquid staking has become the largest category of decentralized finance protocols in terms of total value locked. However, few studies exist on its implementation designs or underlying risks. The liquid staking protocols allow for earning staking rewards without the disadvantage of locking the capital at the validators. Yet, they are seen by some as a threat to the Proof-of-Stake blockchain security. This paper is the first work that classifies liquid staking implementations. It analyzes the historical performance of major liquid staking tokens in comparison to the traditional staking for the largest Proof-of-Stake blockchains. Furthermore, the research investigates the impact of centralization, maximum extractable value and the migration of Ethereum from Proof-of-Work to Proof-of-Stake on the tokens' performance. Examining the tracking error of the liquid stacking providers to the staking rewards shows that they are persistent and cannot be explained by macro-variables of the currency, such as the variance or return.


title: First-order definability of affine Campana points in the projective line over a number field

abstract: We offer a $\forall\exists$-definition for (affine) Campana points over $\mathbb{P}^1_K$ (where $K$ is a number field), which constitute a set-theoretical filtration between $K$ and $\mathcal{O}_{K,S}$ ($S$-integers), which are well-known to be universally defined (Koenigsmann 2010, Park 2012, Eisentraeger & Morrison 2016). We also show that our formulas are uniform with respect to all possible $S$, is parameter-free as such, and we count the number of involved quantifiers and offer a bound for the degree of the defining polynomial.


title: PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathology

abstract: The emergence of large multimodal models has unlocked remarkable potential in AI, particularly in pathology. However, the lack of specialized, high-quality benchmark impeded their development and precise evaluation. To address this, we introduce PathMMU, the largest and highest-quality expert-validated pathology benchmark for Large Multimodal Models (LMMs). It comprises 33,428 multimodal multi-choice questions and 24,067 images from various sources, each accompanied by an explanation for the correct answer. The construction of PathMMU harnesses GPT-4V's advanced capabilities, utilizing over 30,000 image-caption pairs to enrich captions and generate corresponding Q&As in a cascading process. Significantly, to maximize PathMMU's authority, we invite seven pathologists to scrutinize each question under strict standards in PathMMU's validation and test sets, while simultaneously setting an expert-level performance benchmark for PathMMU. We conduct extensive evaluations, including zero-shot assessments of 14 open-sourced and 4 closed-sourced LMMs and their robustness to image corruption. We also fine-tune representative LMMs to assess their adaptability to PathMMU. The empirical findings indicate that advanced LMMs struggle with the challenging PathMMU benchmark, with the top-performing LMM, GPT-4V, achieving only a 49.8% zero-shot performance, significantly lower than the 71.8% demonstrated by human pathologists. After fine-tuning, significantly smaller open-sourced LMMs can outperform GPT-4V but still fall short of the expertise shown by pathologists. We hope that the PathMMU will offer valuable insights and foster the development of more specialized, next-generation LMMs for pathology.


title: cDVGAN: One Flexible Model for Multi-class Gravitational Wave Signal and Glitch Generation

abstract: Simulating realistic time-domain observations of gravitational waves (GWs) and GW detector glitches can help in advancing GW data analysis. Simulated data can be used in downstream tasks by augmenting datasets for signal searches, balancing data sets for machine learning, and validating detection schemes. In this work, we present Conditional Derivative GAN (cDVGAN), a novel conditional model in the Generative Adversarial Network framework for simulating multiple classes of time-domain observations that represent gravitational waves (GWs) and detector glitches. cDVGAN can also generate generalized hybrid samples that span the variation between classes through interpolation in the conditioned class vector. cDVGAN introduces an additional player into the typical 2-player adversarial game of GANs, where an auxiliary discriminator analyzes the first-order derivative time-series. Our results show that this provides synthetic data that better captures the features of the original data. cDVGAN conditions on three classes, two denoised from LIGO blip and tomte glitch events from its 3rd observing run (O3), and the third representing binary black hole (BBH) mergers. Our proposed cDVGAN outperforms 4 different baseline GAN models in replicating the features of the three classes. Specifically, our experiments show that training convolutional neural networks (CNNs) with our cDVGAN-generated data improves the detection of samples embedded in detector noise beyond the synthetic data from other state-of-the-art GAN models. Our best synthetic dataset yields as much as a 4.2% increase in area-under-the-curve (AUC) performance compared to synthetic datasets from baseline GANs. Moreover, training the CNN with hybrid samples from our cDVGAN outperforms CNNs trained only on the standard classes, when identifying real samples embedded in LIGO detector background (4% AUC improvement for cDVGAN).


title: Invariant splitting of a slab into infinitely many robust clusters

abstract: We give an example of an invariant bond percolation process on the slab $\mathbb{Z}^2\times \{0,1\}$ with the property that it has infinitely many clusters whose critical percolation probability is strictly less than $1$. We also show that no such process can exist in $\mathbb{Z}^2$.


title: On the asymptotic behaviour of the Vasconcelos invariant for graded modules

abstract: The notion of Vasconcelos invariant, known in the literature as v-number, of a homogeneous ideal in a polynomial ring over a field was introduced in 2020 to study the asymptotic behaviour of the minimum distance of projective Reed-Muller type codes. We initiate the study of this invariant for graded modules. Let $R$ be a Noetherian $\mathbb{N}$-graded ring, and $M$ be a finitely generated graded $R$-module. The v-number $v(M)$ can be defined as the least possible degree of a homogeneous element $x$ of $M$ for which $(0:_Rx)$ is a prime ideal of $R$. For a homogeneous ideal $I$ of $R$, we mainly prove that $v(I^nM)$ and $v(I^nM/I^{n+1}M)$ are eventually linear functions of $n$. In addition, if $(0:_M I)=0$, then $v(M/I^{n}M)$ is also eventually linear with the same leading coefficient as that of $v(I^nM/I^{n+1}M)$. These leading coefficients are described explicitly. The result on the linearity of $v(M/I^{n}M)$ considerably strengthens a recent result of Conca which was shown when $R$ is a domain and $M=R$, and Ficarra-Sgroi where the polynomial case is treated.


title: Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopus

abstract: OpenAlex is a promising open source of scholarly metadata, and competitor to the established proprietary sources, the Web of Science and Scopus. As OpenAlex provides its data freely and openly, it permits researchers to perform bibliometric studies that can be reproduced in the community without licensing barriers. However, as OpenAlex is a rapidly evolving source and the data contained within is expanding and also quickly changing, the question naturally arises as to the trustworthiness of its data. In this empirical paper, we will study the reference and metadata coverage within each database and compare them with each other to help address this open question in bibliometrics. In our large-scale study, we demonstrate that, when restricted to a cleaned dataset of 16,788,282 recent publications shared by all three databases, OpenAlex has average reference numbers comparable to both Web of Science and Scopus. We also demonstrate that the comparison of other core metadata covered by OpenAlex shows mixed results, with OpenAlex capturing more ORCID identifiers, fewer abstracts and a similar number of Open Access information per article when compared to both Web of Science and Scopus.


title: $\ell$-Proca stars

abstract: Initially applied to the scalar case, we extend the applicability of the multi-field generalization with angular momentum of bosonic stars to the vector case, in order to obtain new configurations that generalize the one-field spherical Proca stars. These new objects, which we call $\ell$-Proca stars, arise as stationary and spherically symmetric bosonic stars solutions of the Einstein-(multi)Proca system, whose matter content is formed by an arbitrary odd number of $2\ell+1$ of complex Proca fields with the same mass, time-frequency, radial profile and angular momentum number $\ell$. We analyze the system of constraint and evolution radial equations for the matter content to show the consistency of our proposal, and obtain numerically the ground states of these new solutions for the first few values of $\ell$ using spectral methods.


title: MIRI MRS Observations of Beta Pictoris I. The Inner Dust, the Planet, and the Gas

abstract: We present JWST MIRI Medium Resolution Spectrograph (MRS) observations of the $\beta$ Pictoris system. We detect an infrared excess from the central unresolved point source from 5 to 7.5 $\mu$m which is indicative of dust within the inner $\sim$7 au of the system. We perform PSF subtraction on the MRS data cubes and detect a spatially resolved dust population emitting at 5 $\mu$m. This spatially resolved hot dust population is best explained if the dust grains are in the small grain limit (2$\pi$a$\ll$$\lambda$). The combination of unresolved and resolved dust at 5 $\mu$m could suggest that dust grains are being produced in the inner few au of the system and are then radiatively driven outwards, where the particles could accrete onto the known planets in the system $\beta$ Pic b and c. We also report the detection of an emission line at 6.986 $\mu$m that we attribute to be [Ar II]. We find that the [Ar II] emission is spatially resolved with JWST and appears to be aligned with the dust disk. Through PSF subtraction techniques, we detect $\beta$ Pic b at the 5$\sigma$ level in our MRS data cubes and present the first mid-IR spectrum of the planet from 5 to 7 $\mu$m. The planet's spectrum is consistent with having absorption from water vapor between 5 and 6.5 $\mu$m. We perform atmosphere model grid fitting on spectra and photometry of $\beta$ Pic b and find that the planet's atmosphere likely has a sub-stellar C/O ratio.


title: Quantum process matrices as images: new tools to design novel denoising methods

abstract: Inferring a process matrix characterizing a quantum channel from experimental measurements is a key issue of quantum information. Sometimes the noise affecting the measured counts brings to matrices very different from the expected ones and the mainly used estimation procedure, i.e. the maximum likelihood estimation (MLE), is also characterized by several drawbacks. To lower the noise could be necessary to increase the experimental resources, e.g. time for each measurement. In this paper, an alternative procedure, based on suitable Neural Networks, has been implemented and optimized to obtain a denoised process matrix and this approach has been tested with a specific quantum channel, i.e. a Control Phase. This promising method relies on the analogy that can be established between the elements of a process matrix and the pixels of an im


title: Evaluation of pseudo-healthy image reconstruction for anomaly detection with deep generative models: Application to brain FDG PET

abstract: Over the past years, pseudo-healthy reconstruction for unsupervised anomaly detection has gained in popularity. This approach has the great advantage of not requiring tedious pixel-wise data annotation and offers possibility to generalize to any kind of anomalies, including that corresponding to rare diseases. By training a deep generative model with only images from healthy subjects, the model will learn to reconstruct pseudo-healthy images. This pseudo-healthy reconstruction is then compared to the input to detect and localize anomalies. The evaluation of such methods often relies on a ground truth lesion mask that is available for test data, which may not exist depending on the application. We propose an evaluation procedure based on the simulation of realistic abnormal images to validate pseudo-healthy reconstruction methods when no ground truth is available. This allows us to extensively test generative models on different kinds of anomalies and measuring their performance using the pair of normal and abnormal images corresponding to the same subject. It can be used as a preliminary automatic step to validate the capacity of a generative model to reconstruct pseudo-healthy images, before a more advanced validation step that would require clinician's expertise. We apply this framework to the reconstruction of 3D brain FDG PET using a convolutional variational autoencoder with the aim to detect as early as possible the neurodegeneration markers that are specific to dementia such as Alzheimer's disease.


title: Fabrication and characterization of optical filters from polymeric aerogels loaded with diamond scattering particles

abstract: We have developed a suite of infrared-blocking filters made by embedding diamond scattering particles in a polyimide aerogel substrate. We demonstrate the ability to tune the spectral performance of the filters based on both the composition of the base aerogel material and the properties of the scattering particles. We summarize the fabrication, optical modeling, and characterization of these filters. We investigate two polyimide base aerogel formulations and the effects of loading them with diamond scattering particles of varying sizes and relative densities. We describe a model for the filters' behavior using a combination of Maxwell Garnett and Mie Scattering techniques. We present optical characterization results for diamond-loaded aerogel filters with cutoff frequencies (50% transmittance) ranging between 2.5 and 15 THz, and confirm that the measured spectral performance is in agreement with our optical models. We also measure the filters' refractive index in the microwave and report findings in agreement with Maxwell Garnett model predictions (typically n < 1.08).


title: The scaling limit of critical hypercube percolation

abstract: We study the connected components in critical percolation on the Hamming hypercube $\{0,1\}^m$. We show that their sizes rescaled by $2^{-2m/3}$ converge in distribution, and that, considered as metric measure spaces with the graph distance rescaled by $2^{-m/3}$ and the uniform measure, they converge in distribution with respect to the Gromov-Hausdorff-Prokhorov topology. The two corresponding limits are as in critical Erd\H{o}s-R\'enyi graphs.


title: Choiceless Polynomial Space

abstract: Abstract State Machines (ASMs) provide a model of computations on structures rather than strings. Blass, Gurevich and Shelah showed that deterministic PTIME-bounded ASMs define the choiceless fragment of PTIME, but cannot capture PTIME. In this article deterministic PSPACE-bounded ASMs are introduced, and it is proven that they cannot capture PSPACE. The key for the proof is a characterisation by partial fixed-point formulae over the St\"ark/Nanchen logic for deterministic ASMs and a construction of transitive structures, in which such formulae must hold. This construction exploits that the decisive support theorem for choiceless polynomial time holds under slightly weaker assumptions.


title: TQCompressor: improving tensor decomposition methods in neural networks via permutations

abstract: We introduce TQCompressor, a novel method for neural network model compression with improved tensor decompositions. We explore the challenges posed by the computational and storage demands of pre-trained language models in NLP tasks and propose a permutation-based enhancement to Kronecker decomposition. This enhancement makes it possible to reduce loss in model expressivity which is usually associated with factorization. We demonstrate this method applied to the GPT-2$_{small}$. The result of the compression is TQCompressedGPT-2 model, featuring 81 mln. parameters compared to 124 mln. in the GPT-2$_{small}$. We make TQCompressedGPT-2 publicly available. We further enhance the performance of the TQCompressedGPT-2 through a training strategy involving multi-step knowledge distillation, using only a 3.1% of the OpenWebText. TQCompressedGPT-2 surpasses DistilGPT-2 and KnGPT-2 in comparative evaluations, marking an advancement in the efficient and effective deployment of models in resource-constrained environments.


title: A new numerical method for scalar eigenvalue problems in heterogeneous, dispersive, sign-changing materials

abstract: We consider time-harmonic scalar transmission problems between dielectric and dispersive materials with generalized Lorentz frequency laws. For certain frequency ranges such equations involve a sign-change in their principle part. Due to the resulting loss of coercivity properties, the numerical simulation of such problems is demanding. Furthermore, the related eigenvalue problems are nonlinear and give rise to additional challenges. We present a new finite element method for both of these types of problems, which is based on a weakly coercive reformulation of the PDE. The new scheme can handle $C^{1,1}$-interfaces consisting piecewise of elementary geometries. Neglecting quadrature errors, the method allows for a straightforward convergence analysis. In our implementation we apply a simple, but nonstandard quadrature rule to achieve negligible quadrature errors. We present computational experiments in 2D and 3D for both source and eigenvalue problems which confirm the stability and convergence of the new scheme.


title: Mixed-Order Meshes through rp-adaptivity for Surface Fitting to Implicit Geometries

abstract: Computational analysis with the finite element method requires geometrically accurate meshes. It is well known that high-order meshes can accurately capture curved surfaces with fewer degrees of freedom in comparison to low-order meshes. Existing techniques for high-order mesh generation typically output meshes with same polynomial order for all elements. However, high order elements away from curvilinear boundaries or interfaces increase the computational cost of the simulation without increasing geometric accuracy. In prior work, we have presented one such approach for generating body-fitted uniform-order meshes that takes a given mesh and morphs it to align with the surface of interest prescribed as the zero isocontour of a level-set function. We extend this method to generate mixed-order meshes such that curved surfaces of the domain are discretized with high-order elements, while low-order elements are used elsewhere. Numerical experiments demonstrate the robustness of the approach and show that it can be used to generate mixed-order meshes that are much more efficient than high uniform-order meshes. The proposed approach is purely algebraic, and extends to different types of elements (quadrilaterals/triangles/tetrahedron/hexahedra) in two- and three-dimensions.


title: Magnetically driven winds from accretion disks in post-asymptotic giant branch binaries

abstract: Context. Jets are commonly detected in post-asymptotic giant branch (post-AGB) binaries and originate from an accretion process onto the companion of the post-AGB primary. These jets are revealed by high-resolution spectral time series. Aims. This paper is part of a series. In this work, we move away from our previous parametric modelling and include a self-similar wind model that allows the physical properties of post-AGB binaries to be characterised. This model describes magnetically driven jets from a thin accretion disk threaded by a large-scale, near equipartition vertical field. Methods. We expanded our methodology in order to simulate the high-resolution dynamic spectra coming from the obscuration of the primary by the jets launched by the companion. We present the framework to exploit the self-similar jet models for post-AGB binaries. We performed a parameter study to investigate the impact of different parameters (inclination, accretion rate, inner and outer launching radius) on the synthetic spectra. Results. We successfully included the physical jet models into our framework. The synthetic spectra have a very similar orbital phase coverage and absorption strengths as the observational data. The magnetohydrodynamic (MHD) jet models provide a good representation of the actual jet creation process in these evolved binaries. Challenges remain, however, as the needed high-accretion rate would induce accretion disks that are too hot in comparison to the data. Moreover, the rotational signature of the models is not detected in the observations. In future research, we will explore models with a higher disk ejection efficiency and even lower magnetisation in order to solve some of the remaining discrepancies between the observed and synthetic dynamic spectra.


title: Kubota-type formulas and supports of mixed measures

abstract: Motivated by a problem for mixed Monge-Amp\`ere measures of convex functions, we address a special case of a conjecture of Schneider and show that for every convex body $K$ the support of the mixed area measure $S(K[j],B_L^{n-1}[n-1-j],\cdot)$ is given by the set of $(K[j],B_L^{n-1}[n-1-j])$-extreme unit normal vectors, where $B_L^{n-1}$ denotes the $(n-1)$-dimensional Euclidean unit ball in a hyperplane $L$. As a consequence, we see that the supports of these measures are nested. Our proof introduces a Kubota-type formula for mixed area measures, which involves integration over $j$-dimensional linear subspaces that contain a fixed $1$-dimensional subspace. We transfer these results to the analytic setting, where we obtain corresponding statements for (conjugate) mixed Monge-Amp\`ere measures of convex functions. Thereby, we establish a fundamental property for functional intrinsic volumes. In addition, we study connections between mixed Monge-Amp\`ere measures of convex functions and mixed area measures and mixed volumes of convex bodies.


title: Duality between controllability and observability for target control and estimation in networks

abstract: Controllability and observability are properties that establish the existence of full-state controllers and observers, respectively. The notions of output controllability and functional observability are generalizations that enable respectively the control and estimation of part of the state vector. These generalizations are of utmost importance in applications to high-dimensional systems, such as large-scale networks, in which only a target subset of variables (nodes) are sought to be controlled or estimated. Although the duality between controllability and observability is well established, the characterization of the duality between their generalized counterparts remains an outstanding problem. Here, we establish both the weak and the strong duality between output controllability and functional observability. Specifically, we show that functional observability of a system implies output controllability of a dual system (weak duality), and that under a certain condition the converse also holds (strong duality). As an application of the strong duality principle, we derive a necessary and sufficient condition for target control via static feedback. This allow us to establish a separation principle between the design of a feedback target controller and the design of a functional observer in closed-loop systems. These results generalize the well-known duality and separation principles in modern control theory.

categories: math.OC cond-mat.dis-nn cs.SY eess.SY math.DS physics.soc-ph


title: Bayesian optimization as a flexible and efficient design framework for sustainable process systems

abstract: Bayesian optimization (BO) is a powerful technology for optimizing noisy expensive-to-evaluate black-box functions, with a broad range of real-world applications in science, engineering, economics, manufacturing, and beyond. In this paper, we provide an overview of recent developments, challenges, and opportunities in BO for design of next-generation process systems. After describing several motivating applications, we discuss how advanced BO methods have been developed to more efficiently tackle important problems in these applications. We conclude the paper with a summary of challenges and opportunities related to improving the quality of the probabilistic model, the choice of internal optimization procedure used to select the next sample point, and the exploitation of problem structure to improve sample efficiency.


title: Analytic Model for Molecules Under Collective Vibrational Strong Coupling in Optical Cavities

abstract: Analytical results are presented for a model system consisting of an ensemble of N molecules under vibrational strong coupling (VSC). The single bare molecular model is composed of one effective electron, which couples harmonically to multiple nuclei. A priori no harmonic approximation is imposed for the inter-nuclear interactions. Within the cavity Born-Oppenheimer partitioning, i.e., when assuming classical nuclei and displacement field coordinates, the dressed N-electron problem can be solved analytically in the dilute limit. In more detail, we present a self-consistent solution of the corresponding cavity-Hartree equations, which illustrates the relevance of the non-perturbative treatment of electronic screening effects under VSC. We exemplify our derivations for an ensemble of harmonic model CO2 molecules, which shows that common simplifications can introduce non-physical effects (e.g., a spurious coupling of the transverse field to the center-of-mass motion for neutral atoms). In addition, our self-consistent solution reveals a simple analytic expression for the cavity-induced red shift and the associated refractive index, which can be interpreted as a polarizability-dependent detuning of the cavity. Finally, we highlight that anharmonic intra-molecular interactions might become essential for the formation of local strong coupling effects within a molecular ensemble under collective VSC.


title: Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator

abstract: Layout generation is a critical step in graphic design to achieve meaningful compositions of elements. Most previous works view it as a sequence generation problem by concatenating element attribute tokens (i.e., category, size, position). So far the autoregressive approach (AR) has achieved promising results, but is still limited in global context modeling and suffers from error propagation since it can only attend to the previously generated tokens. Recent non-autoregressive attempts (NAR) have shown competitive results, which provides a wider context range and the flexibility to refine with iterative decoding. However, current works only use simple heuristics to recognize erroneous tokens for refinement which is inaccurate. This paper first conducts an in-depth analysis to better understand the difference between the AR and NAR framework. Furthermore, based on our observation that pixel space is more sensitive in capturing spatial patterns of graphic layouts (e.g., overlap, alignment), we propose a learning-based locator to detect erroneous tokens which takes the wireframe image rendered from the generated layout sequence as input. We show that it serves as a complementary modality to the element sequence in object space and contributes greatly to the overall performance. Experiments on two public datasets show that our approach outperforms both AR and NAR baselines. Extensive studies further prove the effectiveness of different modules with interesting findings. Our code will be available at https://github.com/ffffatgoose/SpotError.


title: The MASSIVE survey -- XIX. Molecular gas measurements of the supermassive black hole masses in the elliptical galaxies NGC 1684 and NGC 0997

abstract: Supermassive black hole (SMBH) masses can be measured by observing their dynamical effects on tracers, such as molecular gas. We present high angular resolution Atacama Large Millimeter/submillimeter Array (ALMA) observations of the $^{12}$CO(2-1) line emission of the early-type galaxies (ETGs) NGC 1684 and NGC 0997, obtained as part of the MASSIVE survey, a volume-limited integral-field spectroscopic study of the most massive local ETGs. NGC 1684 has a regularly-rotating central molecular gas disc, with a spatial extent of $\approx 6 "$ ($\approx1.8$ kpc) in radius and a central hole slightly larger than the expected SMBH sphere of influence. We forward model the data cube in a Bayesian framework with the Kinematic Molecular Simulation (KinMS) code and infer a SMBH mass of $1.40^{+0.44}_{-0.39}\times10^9$ M$_\odot$ ($3\sigma$ confidence interval) and a F110W-filter stellar mass-to-light ratio of $(2.50\pm0.05)$ M$_\odot/\text{L}_{\odot,\text{F110W}}$. NGC 0997 has a regularly-rotating central molecular gas disc, with a spatial extent of $\approx5 "$ ($\approx2.2$ kpc) in radius and a partially-filled central hole much larger than the expected SMBH sphere of influence, thus preventing a robust SMBH mass determination. With the same modelling method, we nevertheless constrain the SMBH mass to be in the range $4.0\times10^7$ to $1.8\times10^9$ M$_\odot$ and the F160W-filter stellar mass-to-light ratio to be $(1.52\pm0.11)$ M$_\odot/\text{L}_{\odot,\text{F160W}}$. Both SMBH masses are consistent with the SMBH mass -- stellar velocity dispersion ($M_{\text{BH}}$ -- $\sigma_\text{e}$) relation, suggesting that the over-massive SMBHs present in other very massive ETGs are fairly uncommon.


title: Large time behaviour for the heat equation on $\Z,$ moments and decay rates

abstract: The paper is devoted to understand the large time behaviour and decay of the solution of the discrete heat equation in the one dimensional mesh $\Z$ on $\ell^p$ spaces, and its analogies with the continuous-space case. We do a deep study of the moments of the discrete gaussian kernel (which is given in terms of Bessel functions), in particular the mass conservation principle; that is reflected on the large time behaviour of solutions. We prove asymptotic pointwise and $\ell^p$ decay results for the fundamental solution. We use that estimates to get rates on the $\ell^p$ decay and large time behaviour of solutions. For the $\ell^2$ case, we get optimal decay by use of Fourier techniques.


title: Decomposing dense matrices into dense Pauli tensors

abstract: Decomposing a matrix into a weighted sum of Pauli strings is a common chore of the quantum computer scientist, whom is not easily discouraged by exponential scaling. But beware, a naive decomposition can be cubically more expensive than necessary! In this manuscript, we derive a fixed-memory, branchless algorithm to compute the inner product between a 2^N-by-2^N complex matrix and an N-term Pauli tensor in O(2^N) time, by leveraging the Gray code. Our scheme permits the embarrassingly parallel decomposition of a matrix into a weighted sum of Pauli strings in O(8^N) time. We implement our algorithm in Python, hosted open-source on Github, and benchmark against a recent state-of-the-art method called the "PauliComposer" which has an exponentially growing memory overhead, achieving speedups in the range of 1.5x to 5x for N < 8. Note that our scheme does not leverage sparsity, diagonality, Hermitivity or other properties of the input matrix which might otherwise enable optimised treatment in other methods. As such, our algorithm is well-suited to decomposition of dense, arbitrary, complex matrices which are expected dense in the Pauli basis, or for which the decomposed Pauli tensors are a priori unknown.


title: Exponentially Fitted Finite Difference Approximation for Singularly Perturbed Fredholm Integro-Differential Equation

abstract: In this paper, we concentrate on solving second-order singularly perturbed Fredholm integro-differential equations (SPFIDEs). It is well known that solving these equations analytically is a challenging endeavor because of the presence of boundary and interior layers within the domain. To overcome these challenges, we develop a fitted second-order difference scheme that can capture the layer behavior of the solution accurately and efficiently, which is again, based on the integral identities with exponential basis functions, the composite trapezoidal rule, and an appropriate interpolating quadrature rules with the remainder terms in the integral form on a piecewise uniform mesh. Hence, our numerical method acts as a superior alternative to the existing methods in the literature. Further, using appropriate techniques in error analysis the scheme's convergence and stability have been studied in the discrete max norm. We have provided necessary experimental evidence that corroborates the theoretical results with a high degree of accuracy.


title: Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

abstract: Large language models are trained on massive scrapes of the web, which are often unstructured, noisy, and poorly phrased. Current scaling laws show that learning from such data requires an abundance of both compute and data, which grows with the size of the model being trained. This is infeasible both because of the large compute costs and duration associated with pre-training, and the impending scarcity of high-quality data on the web. In this work, we propose Web Rephrase Augmented Pre-training ($\textbf{WRAP}$) that uses an off-the-shelf instruction-tuned model prompted to paraphrase documents on the web in specific styles such as "like Wikipedia" or in "question-answer format" to jointly pre-train LLMs on real and synthetic rephrases. First, we show that using WRAP on the C4 dataset, which is naturally noisy, speeds up pre-training by $\sim3x$. At the same pre-training compute budget, it improves perplexity by more than 10% on average across different subsets of the Pile, and improves zero-shot question answer accuracy across 13 tasks by more than 2%. Second, we investigate the impact of the re-phrasing style on the performance of the model, offering insights into how the composition of the training data can impact the performance of LLMs in OOD settings. Our gains are attributed to the fact that re-phrased synthetic data has higher utility than just real data because it (i) incorporates style diversity that closely reflects downstream evaluation style, and (ii) has higher 'quality' than web-scraped data.


title: Highly Efficient Encoding for Job-Shop Scheduling Problems and its Application on Quantum Computers

abstract: Combinatorial optimization problems are considered to be an application, where quantum computing can have transformative impact. In the industrial context, job shop scheduling problems that aim at finding the optimal schedule for a set of jobs to be run on a set of machines are of immense interest. Here we introduce an efficient encoding of job shop scheduling problems, which requires much fewer bit-strings for counting all possible schedules than previously employed encodings. For problems consisting of $N$ jobs with $N$ operations, the number of required bit-strings is at least reduced by a factor $N / \log_2(N)$ as compared to time indexed encodings. This is particularly beneficial for solving job shop scheduling problems on quantum computers, since much fewer qubits are needed to represent the problem. Our approach applies to the large class of flexible and usual job-shop scheduling problems, where operations can possibly be executed on multiple machines. Using variational quantum algorithms, we show that the encoding we introduce leads to significantly better performance of quantum algorithms than previously considered strategies. Importantly, the encoding we develop also enables significantly more compact classical representations and will therefore be highly useful even beyond applicability on quantum hardware.


title: A KDM-Based Approach for Architecture Conformance Checking in Adaptive Systems

abstract: Adaptive Systems (ASs) are capable to monitor their behavior and make adjustments when quality goals are not achieved through the MAPE-K, a widely recognized reference model that offers abstractions for designing ASs. By making these abstractions evident in the system structure, numerous benefits emerge, particularly in terms of enhancing the architecture's maintenance and comprehensibility. However, it is observed that many existing ASs are not designed in accordance with MAPE-K, causing these abstractions to remain hidden in their architecture. To address this issue, Architectural Conformance Checking (ACC) emerges as a valuable technique for verifying whether the current architecture (CA) of a system adheres to the rules prescribed by the planned architecture (PA) or a reference model, such as MAPE-K. In this paper, we present REMEDY, a domain-specific approach that encompasses the specification of the planned adaptive architecture based on the MAPE-K reference model, the recovery of the current adaptive architecture, the conformance checking process, and architecture visualizations. Furthermore, our approach is specifically tailored for ASs, incorporating well-known rules from the MAPE-K model. The evaluation of the REMEDY DSL involves a comparison with a general-purpose DSL, and the results demonstrate improvements in productivity. REMEDY facilitates the identification and correction of architectural non-conformance issues, thereby enhancing the overall quality of adaptive systems.


title: Learning logic programs by finding minimal unsatisfiable subprograms

abstract: The goal of inductive logic programming (ILP) is to search for a logic program that generalises training examples and background knowledge. We introduce an ILP approach that identifies minimal unsatisfiable subprograms (MUSPs). We show that finding MUSPs allows us to efficiently and soundly prune the search space. Our experiments on multiple domains, including program synthesis and game playing, show that our approach can reduce learning times by 99%.


title: Theory of intrinsic acoustic plasmons in twisted bilayer graphene

abstract: We present a theoretical study of the intrinsic plasmonic properties of twisted bilayer graphene (TBG) as a function of the twist angle $\theta$ (and other microscopic parameters such as temperature and filling factor). Our calculations, which rely on the random phase approximation, take into account four crucially important effects, which are treated on equal footing: i) the layer-pseudospin degree of freedom, ii) spatial non-locality of the density-density response function, iii) crystalline local field effects, and iv) Hartree self-consistency. We show that the plasmonic spectrum of TBG displays a smooth transition from a strongly-coupled regime (at twist angles $\theta \lesssim 2^{\circ}$), where the low-energy spectrum is dominated by a weakly dispersive intra-band plasmon, to a weakly-coupled regime (for twist angles $\theta \gtrsim 2^{\circ}$) where an acoustic plasmon clearly emerges. This crossover offers the possibility of realizing tunable mid-infrared sub-wavelength cavities, whose vacuum fluctuations may be used to manipulate the ground state of strongly correlated electron systems.


title: Dipole superfluid hydrodynamics II

abstract: We present a dissipative hydrodynamic theory of "s-wave dipole superfluids" that arise in phases of translation-invariant and dipole-symmetric models in which the U(1) symmetry is spontaneously broken. The hydrodynamic description is subtle on account of an analogue of dangerously irrelevant operators, which requires us to formalize an entirely new derivative counting scheme suitable for these fluids. We use our hydrodynamic model to investigate the linearized response of such a fluid, characterized by sound modes $\omega \sim \pm k - ik^2$, shear modes $\omega\sim-ik^2$, and magnon-like propagating modes $\omega \sim \pm k^2 - ik^4$ that are the dipole-invariant version of superfluid "second sound" modes. We find that these fluids can also admit equilibrium states with "dipole superflow" that resemble a polarized medium. Finally, we couple our theory to slowly varying background fields, which allows us to compute response functions of hydrodynamic operators and Kubo formulas for hydrodynamic transport coefficients.


title: Continual Learning with Pre-Trained Models: A Survey

abstract: Nowadays, real-world applications often face streaming data, which requires the learning system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve this goal and meanwhile overcome the catastrophic forgetting of former knowledge when learning new ones. Typical CL methods build the model from scratch to grow with incoming data. However, the advent of the pre-trained model (PTM) era has sparked immense research interest, particularly in leveraging PTMs' robust representational capabilities. This paper presents a comprehensive survey of the latest advancements in PTM-based CL. We categorize existing methodologies into three distinct groups, providing a comparative analysis of their similarities, differences, and respective advantages and disadvantages. Additionally, we offer an empirical study contrasting various state-of-the-art methods to highlight concerns regarding fairness in comparisons. The source code to reproduce these evaluations is available at: https://github.com/sun-hailong/LAMDA-PILOT


title: Green Adaptation of Real-Time Web Services for Industrial CPS within a Cloud Environment

abstract: Managing energy efficiency under timing constraints is an interesting and big challenge. This work proposes an accurate power model in data centers for time-constrained servers in Cloud computing. This model, as opposed to previous approaches, does not only consider the workload assigned to the processing element, but also incorporates the need of considering the static power consumption and, even more interestingly, its dependency with temperature. The proposed model has been used in a multi-objective optimization environment in which the Dynamic Voltage and Frequency Scaling (DVFS) and workload assignment have been efficiently optimized.


title: SuNeRF: 3D reconstruction of the solar EUV corona using Neural Radiance Fields

abstract: To understand its evolution and the effects of its eruptive events, the Sun is permanently monitored by multiple satellite missions. The optically-thin emission of the solar plasma and the limited number of viewpoints make it challenging to reconstruct the geometry and structure of the solar atmosphere; however, this information is the missing link to understand the Sun as it is: a three-dimensional evolving star. We present a method that enables a complete 3D representation of the uppermost solar layer (corona) observed in extreme ultraviolet (EUV) light. We use a deep learning approach for 3D scene representation that accounts for radiative transfer, to map the entire solar atmosphere from three simultaneous observations. We demonstrate that our approach provides unprecedented reconstructions of the solar poles, and directly enables height estimates of coronal structures, solar filaments, coronal hole profiles, and coronal mass ejections. We validate the approach using model-generated synthetic EUV images, finding that our method accurately captures the 3D geometry of the Sun even from a limited number of 32 ecliptic viewpoints ($|\text{latitude}| \leq 7^\circ$). We quantify uncertainties of our model using an ensemble approach that allows us to estimate the model performance in absence of a ground-truth. Our method enables a novel view of our closest star, and is a breakthrough technology for the efficient use of multi-instrument datasets, which paves the way for future cluster missions.


title: Inclusive photoproduction of charmonia-bottomonia pairs

abstract: In this preprint we analyze the inclusive photoproduction of heavy charmonia-bottomonia pairs in the Color Glass Condensate framework and demonstrate that the cross-section of the process is sensitive to dipole and quadrupole forward scattering amplitudes (2- and 4-point correlators of Wilson lines). Using the phenomenological parametrizations of these amplitudes, we estimate numerically the production cross-sections in the kinematics of the forthcoming Electron Ion Collider and the ultraperipheral collisions at LHC. We found that the contribution controlled by the quadrupole amplitude is dominant, and for this reason, the suggested channel can be used as a gateway for studies of this nonperturbative object.


title: Quantum Private Membership Aggregation

abstract: We consider the problem of private set membership aggregation of $N$ parties by using an entangled quantum state. In this setting, the $N$ parties, which share an entangled state, aim to \emph{privately} know the number of times each element (message) is repeated among the $N$ parties, with respect to a universal set $\mathcal{K}$. This problem has applications in private comparison, ranking, voting, etc. We propose an encoding algorithm that maps the classical information into distinguishable quantum states, along with a decoding algorithm that exploits the distinguishability of the mapped states. The proposed scheme can also be used to calculate the $N$ party private summation modulo $P$.

categories: cs.IT cs.CR cs.NI eess.SP math.IT quant-ph


title: Practical Framework for Problem-Based Learning in an Introductory Circuit Analysis Course

abstract: Introductory courses on electric circuits at undergraduate level are usually presented in quite abstract terms, with questions and problems quite far from practical problems. This causes the students have difficulties to apply that theory to solve practical technical problems. On the other hand, electric circuits are everywhere in our lives, so we have plenty of real practical problems. Here we compile a selection of practical contexts suited for implementing Problem Based Learning approach in an introductory course on circuit analysis. And some examples describing the gamification process that uses these problems to build single-player role-playing games that fulfil the course contents and scheduling. The key point of the assessment and how it is related to the progress in the game is also described.


title: A comprehensive survey of the home advantage in American football

abstract: The existence and justification to the home advantage -- the benefit a sports team receives when playing at home -- has been studied across sport. The majority of research on this topic is limited to individual leagues in short time frames, which hinders extrapolation and a deeper understanding of possible causes. Using nearly two decades of data from the National Football League (NFL), the National Collegiate Athletic Association (NCAA), and high schools from across the United States, we provide a uniform approach to understanding the home advantage in American football. Our findings suggest home advantage is declining in the NFL and the highest levels of collegiate football, but not in amateur football. This increases the possibility that characteristics of the NCAA and NFL, such as travel improvements and instant replay, have helped level the playing field.


title: Amazon's 2023 Drought: Sentinel-1 Reveals Extreme Rio Negro River Contraction

abstract: The Amazon, the world's largest rainforest, faces a severe historic drought. The Rio Negro River, one of the major Amazon River tributaries, reaches its lowest level in a century in October 2023. Here, we used a U-net deep learning model to map water surfaces in the Rio Negro River basin every 12 days in 2022 and 2023 using 10 m spatial resolution Sentinel-1 satellite radar images. The accuracy of the water surface model was high with an F1-score of 0.93. The 12 days mosaic time series of water surface was generated from the Sentinel-1 prediction. The water surface mask demonstrated relatively consistent agreement with the Global Surface Water (GSW) product from Joint Research Centre (F1-score: 0.708) and with the Brazilian Mapbiomas Water initiative (F1-score: 0.686). The main errors of the map were omission errors in flooded woodland, in flooded shrub and because of clouds. Rio Negro water surfaces reached their lowest level around the 25th of November 2023 and were reduced to 68.1\% (9,559.9 km$^2$) of the maximum water surfaces observed in the period 2022-2023 (14,036.3 km$^2$). Synthetic Aperture Radar (SAR) data, in conjunction with deep learning techniques, can significantly improve near real-time mapping of water surface in tropical regions.


title: Majority of water hides deep in the interiors of exoplanets

abstract: Water is an important component of exoplanets, with its distribution, i.e., whether at the surface or deep inside, fundamentally influencing the planetary properties. The distribution of water in most exoplanets is determined by yet-unknown partitioning coefficients at extreme conditions. Our new first-principles molecular dynamics simulations reveal that water strongly partitions into iron over silicate at high pressures and thus would preferentially stay in a planet's core. Furthermore, we model planet interiors by considering the effect of water on density, melting temperature, and water partitioning. The results shatter the notion of water worlds as imagined before: the majority of the bulk water budget (even more than 95%) can be stored deep within the core and the mantle, and not at the surface. For planets more massive than ~6 Earth's mass and Earth-size planets (of lower mass and small water budgets), the majority of water resides deep in the cores of planets, Whether water is assumed to be at the surface or at depth can affect the radius by up to 25% for a given mass. This has drastic consequences for the inferred water distribution in exoplanets from mass-radius data.


title: Deciding Subtyping for Asynchronous Multiparty Sessions

abstract: Multiparty session types (MSTs) are a type-based approach to verifying communication protocols, represented as global types in the framework. We present a precise subtyping relation for asynchronous MSTs with communicating state machines (CSMs) as implementation model. We address two problems: when can a local implementation safely substitute another, and when does an arbitrary CSM implement a global type? We define safety with respect to a given global type, in terms of subprotocol fidelity and deadlock freedom. Our implementation model subsumes existing work which considers local types with restricted choice. We exploit the connection between MST subtyping and refinement to formulate concise conditions that are directly checkable on the candidate implementations, and use them to show that both problems are decidable in polynomial time.


title: Ovarian Cancer Diagnostics using Wavelet Packet Scaling Descriptors

abstract: Detecting early-stage ovarian cancer accurately and efficiently is crucial for timely treatment. Various methods for early diagnosis have been explored, including a focus on features derived from protein mass spectra, but these tend to overlook the complex interplay across protein expression levels. We propose an innovative method to automate the search for diagnostic features in these spectra by analyzing their inherent scaling characteristics. We compare two techniques for estimating the self-similarity in a signal using the scaling behavior of its wavelet packet decomposition. The methods are applied to the mass spectra using a rolling window approach, yielding a collection of self-similarity indexes that capture protein interactions, potentially indicative of ovarian cancer. Then, the most discriminatory scaling descriptors from this collection are selected for use in classification algorithms. To assess their effectiveness for early diagnosis of ovarian cancer, the techniques are applied to two datasets from the American National Cancer Institute. Comparative evaluation against an existing wavelet-based method shows that one wavelet packet-based technique led to improved diagnostic performance for one of the analyzed datasets (95.67% vs. 96.78% test accuracy, respectively). This highlights the potential of wavelet packet-based methods to capture novel diagnostic information related to ovarian cancer. This innovative approach offers promise for better early detection and improved patient outcomes in ovarian cancer.


title: Rank-one nonsingular actions of countable groups and their odometer factors

abstract: For an arbitrary countable discrete infinite group $G$, nonsingular rank-one actions are introduced. It is shown that the class of nonsingular rank-one actions coincides with the class of nonsingular $(C,F)$-actions. Given a decreasing sequence $\Gamma_1\supsetneq\Gamma_2\supsetneq\cdots$ of cofinite subgroups in $G$ with $\bigcap_{n=1}^\infty\bigcap_{g\in G}g\Gamma_ng^{-1}=\{1_G\}$, the projective limit of the homogeneous $G$-spaces $G/\Gamma_n$ as $n\to\infty$ is a $G$-space. Endowing this $G$-space with an ergodic nonsingular nonatomic measure we obtain a dynamical system which is called a nonsingular odometer. Necessary and sufficient conditions are found for a rank-one nonsingular $G$-action to have a finite factor and a nonsingular odometer factor in terms of the underlying $(C,F)$-parameters. Similar conditions are also found for a rank-one nonsingular $G$-action to be isomorphic to an odometer. Minimal Radon uniquely ergodic locally compact Cantor models are constructed for the nonsingular rank-one extensions of odometers. Several concrete examples are constructed and several facts are proved that illustrate a sharp difference of the nonsingular noncommutative case from the classical finite measure preserving one: odometer actions which are not of rank one, factors of rank-one systems which are not of rank-one, however each probability preserving odometer is a factor of an infinite measure preserving rank-one system, etc.


title: Zero-shot Imitation Policy via Search in Demonstration Dataset

abstract: Behavioral cloning uses a dataset of demonstrations to learn a policy. To overcome computationally expensive training procedures and address the policy adaptation problem, we propose to use latent spaces of pre-trained foundation models to index a demonstration dataset, instantly access similar relevant experiences, and copy behavior from these situations. Actions from a selected similar situation can be performed by the agent until representations of the agent's current situation and the selected experience diverge in the latent space. Thus, we formulate our control problem as a dynamic search problem over a dataset of experts' demonstrations. We test our approach on BASALT MineRL-dataset in the latent representation of a Video Pre-Training model. We compare our model to state-of-the-art, Imitation Learning-based Minecraft agents. Our approach can effectively recover meaningful demonstrations and show human-like behavior of an agent in the Minecraft environment in a wide variety of scenarios. Experimental results reveal that performance of our search-based approach clearly wins in terms of accuracy and perceptual evaluation over learning-based models.


title: Single-Winner Voting with Alliances: Avoiding the Spoiler Effect

abstract: We study the setting of single-winner elections with ordinal preferences where candidates might be members of \emph{alliances} (which may correspond to e.g., political parties, factions, or coalitions). However, we do not assume that candidates from the same alliance are necessarily adjacent in voters' rankings. In such case, every classical voting rule is vulnerable to the spoiler effect, i.e., the presence of a candidate may harm his or her alliance. We therefore introduce a new idea of \emph{alliance-aware} voting rules which extend the classical ones. We show that our approach is superior both to using classical cloneproof voting rules and to running primaries within alliances before the election. We introduce several alliance-aware voting rules and show that they satisfy the most desirable standard properties of their classical counterparts as well as newly introduced axioms for the model with alliances which, e.g., exclude the possibility of the spoiler effect. Our rules have natural definitions and are simple enough to explain to be used in practice.


title: Gravity and $T\bar{T}$ flows in higher dimensions

abstract: We study systems in arbitrary space-time dimensions where matter, deformed by $\mathrm{T}\bar{\mathrm{T}}$-like irrelevant operators, is coupled to gravity in the Palatini formalism. The dynamically equivalent perspective is investigated, wherein the deformation transitions from the matter action to the gravitational one or vice versa. This alternative viewpoint leads to the emergence of Ricci-based gravity theories, thus providing a high-dimensional generalisation of the well-known equivalence between two-dimensional $\mathrm{T}\bar{\mathrm{T}}$ deformations and coupling to Jackiw-Teitelboim gravity. This dynamical equivalence is examined within the framework of the recently introduced Lagrangian flow equation, which notably led to the discovery of a direct link between Nambu-Goto theory and $\mathrm{T}\bar{\mathrm{T}}$ in $d=2$, as well as significant insights into nonlinear electrodynamics models in $d=4$. The investigation involves explicit examples in $d=4$ dimensions; it builds upon earlier research concerning the metric interpretation of $\mathrm{T}\bar{\mathrm{T}}$-like perturbations, incorporates and extends recent findings in the cosmology-related literature associated to the concept of reframing. We focus on scenarios where the resulting modified gravity theories manifest as Born-Infeld and Starobinsky types.


title: Effective mass and symmetry breaking in the IKKT matrix model from compactification

abstract: The IKKT model is a promising candidate for a non-perturbative description of Type IIB superstring theory. It is known from analytic approaches and numerical simulations that the IKKT matrix model with a mass term admits interesting cosmological solutions. However, this mass term is often introduced by hand, and serves as a regulator in the theory. In the present paper, we show that an effective mass matrix can arise naturally in the IKKT model by imposing a toroidal compactification where the space-time fermions acquire anti-periodic boundary conditions. When six spatial dimensions are chosen to be compact, the effective mass matrix breaks the SO(1,9) space-time symmetry of the IKKT model to SO(1,3) $\times$ SO(6). This paves the way for space-time solutions of the IKKT model where SO(1,9) symmetry is naturally broken to SO(1,3) $\times$ SO(6).


title: A Survey on Visual Anomaly Detection: Challenge, Approach, and Prospect

abstract: Visual Anomaly Detection (VAD) endeavors to pinpoint deviations from the concept of normality in visual data, widely applied across diverse domains, e.g., industrial defect inspection, and medical lesion detection. This survey comprehensively examines recent advancements in VAD by identifying three primary challenges: 1) scarcity of training data, 2) diversity of visual modalities, and 3) complexity of hierarchical anomalies. Starting with a brief overview of the VAD background and its generic concept definitions, we progressively categorize, emphasize, and discuss the latest VAD progress from the perspective of sample number, data modality, and anomaly hierarchy. Through an in-depth analysis of the VAD field, we finally summarize future developments for VAD and conclude the key findings and contributions of this survey.


title: ViLexNorm: A Lexical Normalization Corpus for Vietnamese Social Media Text

abstract: Lexical normalization, a fundamental task in Natural Language Processing (NLP), involves the transformation of words into their canonical forms. This process has been proven to benefit various downstream NLP tasks greatly. In this work, we introduce Vietnamese Lexical Normalization (ViLexNorm), the first-ever corpus developed for the Vietnamese lexical normalization task. The corpus comprises over 10,000 pairs of sentences meticulously annotated by human annotators, sourced from public comments on Vietnam's most popular social media platforms. Various methods were used to evaluate our corpus, and the best-performing system achieved a result of 57.74% using the Error Reduction Rate (ERR) metric (van der Goot, 2019a) with the Leave-As-Is (LAI) baseline. For extrinsic evaluation, employing the model trained on ViLexNorm demonstrates the positive impact of the Vietnamese lexical normalization task on other NLP tasks. Our corpus is publicly available exclusively for research purposes.


title: Localisation of Gamma Ray Bursts using AstroSat Mass Model

abstract: The Cadmium Zinc Telluride Imager (CZTI) aboard AstroSat has good sensitivity to Gamma Ray Bursts (GRBs), with close to 600 detections including about 50 discoveries undetected by other missions. However, CZTI was not designed to be a GRB monitor and lacks localisation capabilities. We introduce a new method of localising GRBs using "shadows" cast on the CZTI detector plane due to absorption and scattering by satellite components and instruments. Comparing the observed distribution of counts on the detector plane with simulated distributions with the AstroSat Mass Model, we can localise GRBs in the sky. Our localisation uncertainty is defined by a two-component model, with a narrow Gaussian component that has close to 50% probability of containing the source, and the remaining spread over a broader Gaussian component with an 11.3 times higher $\sigma$. The width ($\sigma$) of the Gaussian components scales inversely with source counts. We test this model by applying the method to GRBs with known positions and find good agreement between the model and observations. This new ability expands the utility of CZTI in the study of GRBs and other rapid high-energy transients.


title: Scaling Sparse Fine-Tuning to Large Language Models

abstract: Large Language Models (LLMs) are difficult to fully fine-tune (e.g., with instructions or human feedback) due to their sheer number of parameters. A family of parameter-efficient sparse fine-tuning methods have proven promising in terms of performance but their memory requirements increase proportionally to the size of the LLMs. In this work, we scale sparse fine-tuning to state-of-the-art LLMs like LLaMA 2 7B and 13B. We propose SpIEL, a novel sparse fine-tuning method which, for a desired density level, maintains an array of parameter indices and the deltas of these parameters relative to their pretrained values. It iterates over: (a) updating the active deltas, (b) pruning indices (based on the change of magnitude of their deltas) and (c) regrowth of indices. For regrowth, we explore two criteria based on either the accumulated gradients of a few candidate parameters or their approximate momenta estimated using the efficient SM3 optimizer. We experiment with instruction-tuning of LLMs on standard dataset mixtures, finding that SpIEL is often superior to popular parameter-efficient fine-tuning methods like LoRA (low-rank adaptation) in terms of performance and comparable in terms of run time. We additionally show that SpIEL is compatible with both quantization and efficient optimizers, to facilitate scaling to ever-larger model sizes. We release the code for SpIEL at https://github.com/AlanAnsell/peft and for the instruction-tuning experiments at https://github.com/ducdauge/sft-llm.


title: A mathematical theory of power

abstract: This paper proposes a new approach to power in Game Theory. Cooperation and conflict are simulated with a mechanism of payoff alteration, called F-game. Using convex combinations of preferences, an F-game can measure players' attitude to cooperate. We can then define actual and potential power as special relations between different states of the system.


title: Is K-fold cross validation the best model selection method for Machine Learning?

abstract: As a technique that can compactly represent complex patterns, machine learning has significant potential for predictive inference. K-fold cross-validation (CV) is the most common approach to ascertaining the likelihood that a machine learning outcome is generated by chance and frequently outperforms conventional hypothesis testing. This improvement uses measures directly obtained from machine learning classifications, such as accuracy, that do not have a parametric description. To approach a frequentist analysis within machine learning pipelines, a permutation test or simple statistics from data partitions (i.e. folds) can be added to estimate confidence intervals. Unfortunately, neither parametric nor non-parametric tests solve the inherent problems around partitioning small sample-size datasets and learning from heterogeneous data sources. The fact that machine learning strongly depends on the learning parameters and the distribution of data across folds recapitulates familiar difficulties around excess false positives and replication. The origins of this problem are demonstrated by simulating common experimental circumstances, including small sample sizes, low numbers of predictors, and heterogeneous data sources. A novel statistical test based on K-fold CV and the Upper Bound of the actual error (K-fold CUBV) is composed, where uncertain predictions of machine learning with CV are bounded by the \emph{worst case} through the evaluation of concentration inequalities. Probably Approximately Correct-Bayesian upper bounds for linear classifiers in combination with K-fold CV is used to estimate the empirical error. The performance with neuroimaging datasets suggests this is a robust criterion for detecting effects, validating accuracy values obtained from machine learning whilst avoiding excess false positives.


title: A Cooper-pair beam splitter as a feasible source of entangled electrons

abstract: We investigate the generation of an entangled electron pair emerging from a system composed of two quantum dots attached to a superconductor Cooper pair beam splitter. We take into account three processes: Crossed Andreev Reflection, cotuneling, and Coulomb interaction. Together, these processes play crucial roles in the formation of entangled electronic states, with electrons being in spatially separated quantum dots. By using perturbation theory, we derive an analytical effective model that allows a simple picture of the intricate process behind the formation of the entangled state. Several entanglement quantifiers, including quantum mutual information, negativity, and concurrence, are employed to validate our findings. Finally, we define and calculate the covariance associated with the detection of two electrons, each originating from one of the quantum dots with a specific spin value. The time evolution of this observable follows the dynamics of all entanglement quantifiers, thus suggesting that it can be a useful tool for mapping the creation of entangled electrons in future applications within quantum information protocols.


title: Challenges in the rheology of glasses

abstract: In this contribution to the proceedings of the 29th Solvay Conference on Physics I will give an overview of some key challenges in our theoretical understanding of the rheology of glasses, focussing on (i) steady shear flow curves and their relation to the glass and jamming transitions, (ii) ductile versus brittle yielding in shear startup and (iii) yielding under oscillatory shear. I will also briefly discuss connections to the reversible-irreversible and random organization transitions as well as to the broad field of memory formation in materials.


title: ReTaSA: A Nonparametric Functional Estimation Approach for Addressing Continuous Target Shift

abstract: The presence of distribution shifts poses a significant challenge for deploying modern machine learning models in real-world applications. This work focuses on the target shift problem in a regression setting (Zhang et al., 2013; Nguyen et al., 2016). More specifically, the target variable y (also known as the response variable), which is continuous, has different marginal distributions in the training source and testing domain, while the conditional distribution of features x given y remains the same. While most literature focuses on classification tasks with finite target space, the regression problem has an infinite dimensional target space, which makes many of the existing methods inapplicable. In this work, we show that the continuous target shift problem can be addressed by estimating the importance weight function from an ill-posed integral equation. We propose a nonparametric regularized approach named ReTaSA to solve the ill-posed integral equation and provide theoretical justification for the estimated importance weight function. The effectiveness of the proposed method has been demonstrated with extensive numerical studies on synthetic and real-world datasets.


title: Sparse Discrete Empirical Interpolation Method: State Estimation from Few Sensors

abstract: Discrete empirical interpolation method (DEIM) estimates a function from its incomplete pointwise measurements. Unfortunately, DEIM suffers large interpolation errors when few measurements are available. Here, we introduce Sparse DEIM (S-DEIM) for accurately estimating a function even when very few measurements are available. To this end, S-DEIM leverages a kernel vector which has been neglected in previous DEIM-based methods. We derive theoretical error estimates for S-DEIM, showing its relatively small error when an optimal kernel vector is used. When the function is generated by a continuous-time dynamical system, we propose a data assimilation algorithm which approximates the optimal kernel vector using observational time series. We prove that, under certain conditions, data assimilated S-DEIM converges exponentially fast towards the true state. We demonstrate the efficacy of our method on two numerical examples.


title: Learning to Manipulate under Limited Information

abstract: By classic results in social choice theory, any reasonable preferential voting method sometimes gives individuals an incentive to report an insincere preference. The extent to which different voting methods are more or less resistant to such strategic manipulation has become a key consideration for comparing voting methods. Here we measure resistance to manipulation by whether neural networks of varying sizes can learn to profitably manipulate a given voting method in expectation, given different types of limited information about how other voters will vote. We trained over 70,000 neural networks of 26 sizes to manipulate against 8 different voting methods, under 6 types of limited information, in committee-sized elections with 5-21 voters and 3-6 candidates. We find that some voting methods, such as Borda, are highly manipulable by networks with limited information, while others, such as Instant Runoff, are not, despite being quite profitably manipulated by an ideal manipulator with full information. For the two probability models for elections that we use, the overall least manipulable of the 8 methods we study are Condorcet methods, namely Minimax and Split Cycle.


title: The geometric error is less than the pollution error when solving the high-frequency Helmholtz equation with high-order FEM on curved domains

abstract: We consider the $h$-version of the finite-element method, where accuracy is increased by decreasing the meshwidth $h$ while keeping the polynomial degree $p$ constant, applied to the Helmholtz equation. Although the question "how quickly must $h$ decrease as the wavenumber $k$ increases to maintain accuracy?" has been studied intensively since the 1990s, none of the existing rigorous wavenumber-explicit analyses take into account the approximation of the geometry. In this paper we prove that for nontrapping problems solved using straight elements the geometric error is order $kh$, which is then less than the pollution error $k(kh)^{2p}$ when $k$ is large; this fact is then illustrated in numerical experiments. More generally, we prove that, even for problems with strong trapping, using degree four (in 2-d) or degree five (in 3-d) polynomials and isoparametric elements ensures that the geometric error is smaller than the pollution error for most large wavenumbers.


title: A Causal Model for Quantifying Multipartite Classical and Quantum Correlations

abstract: We give an operational definition of information-theoretic resources within a given multipartite classical or quantum correlation. We present our causal model that serves as the source coding side of this correlation and introduce a novel concept of resource rate. We argue that, beyond classical secrecy, additional resources exist that are useful for the security of distributed computing problems, which can be captured by the resource rate. Furthermore, we establish a relationship between resource rate and an extension of Shannon's logarithmic information measure, namely, total correlation. Subsequently, we present a novel quantum secrecy monotone and investigate a quantum hybrid key distribution system as an extension of our causal model. Finally, we discuss some connections to optimal transport (OT) problem.


title: Catalan generating functions for bounded operators

abstract: In this paper we study the solution of the quadratic equation $TY^2-Y+I=0$ where $T$ is a linear and bounded operator on a Banach space $X$. We describe the spectrum set and the resolvent operator of $Y$ in terms of operator $T$. In the case that $ 4T$ is a power-bounded operator, we show that a solution (named Catalan generating function) is given by the Taylor series $$ C(T):=\sum_{n=0}^\infty C_nT^n, $$ where the sequence $(C_n)_{n\ge 0}$ is the well-known Catalan numbers. We express $C(T)$ by means of an integral representation which involves the resolvent operator $(\lambda-T)^{-1}$. Some particular examples to illustrate our results are given, in particular an iterative method defined for square matrices $T$ which involves Catalan numbers.


title: Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting

abstract: In the realm of robot-assisted minimally invasive surgery, dynamic scene reconstruction can significantly enhance downstream tasks and improve surgical outcomes. Neural Radiance Fields (NeRF)-based methods have recently risen to prominence for their exceptional ability to reconstruct scenes but are hampered by slow inference speed, prolonged training, and inconsistent depth estimation. Some previous work utilizes ground truth depth for optimization but is hard to acquire in the surgical domain. To overcome these obstacles, we present Endo-4DGS, a real-time endoscopic dynamic reconstruction approach that utilizes 3D Gaussian Splatting (GS) for 3D representation. Specifically, we propose lightweight MLPs to capture temporal dynamics with Gaussian deformation fields. To obtain a satisfactory Gaussian Initialization, we exploit a powerful depth estimation foundation model, Depth-Anything, to generate pseudo-depth maps as a geometry prior. We additionally propose confidence-guided learning to tackle the ill-pose problems in monocular depth estimation and enhance the depth-guided reconstruction with surface normal constraints and depth regularization. Our approach has been validated on two surgical datasets, where it can effectively render in real-time, compute efficiently, and reconstruct with remarkable accuracy.


title: Channel Coding with Mean and Variance Cost Constraints

abstract: We consider channel coding for discrete memoryless channels (DMCs) with a novel cost constraint that constrains both the mean and the variance of the cost of the codewords. We show that the maximum (asymptotically) achievable rate under the new cost formulation is equal to the capacity-cost function; in particular, the strong converse holds. We further characterize the optimal second-order coding rate of these cost-constrained codes; in particular, the optimal second-order coding rate is finite. We then show that the second-order coding performance is strictly improved with feedback using a new variation of timid/bold coding, significantly broadening the applicability of timid/bold coding schemes from unconstrained compound-dispersion channels to all cost-constrained channels. Equivalent results on the minimum average probability of error are also given.


title: Boolean Logic as an Error feedback mechanism

abstract: The notion of Boolean logic backpropagation was introduced to build neural networks with weights and activations being Boolean numbers. Most of computations can be done with Boolean logic instead of real arithmetic, both during training and inference phases. But the underlying discrete optimization problem is NP-hard, and the Boolean logic has no guarantee. In this work we propose the first convergence analysis, under standard non-convex assumptions.


title: Semi-parametric Expert Bayesian Network Learning with Gaussian Processes and Horseshoe Priors

abstract: This paper proposes a model learning Semi-parametric relationships in an Expert Bayesian Network (SEBN) with linear parameter and structure constraints. We use Gaussian Processes and a Horseshoe prior to introduce minimal nonlinear components. To prioritize modifying the expert graph over adding new edges, we optimize differential Horseshoe scales. In real-world datasets with unknown truth, we generate diverse graphs to accommodate user input, addressing identifiability issues and enhancing interpretability. Evaluation on synthetic and UCI Liver Disorders datasets, using metrics like structural Hamming Distance and test likelihood, demonstrates our models outperform state-of-the-art semi-parametric Bayesian Network model.


title: InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Model

abstract: We introduce InternLM-XComposer2, a cutting-edge vision-language model excelling in free-form text-image composition and comprehension. This model goes beyond conventional vision-language understanding, adeptly crafting interleaved text-image content from diverse inputs like outlines, detailed textual specifications, and reference images, enabling highly customizable content creation. InternLM-XComposer2 proposes a Partial LoRA (PLoRA) approach that applies additional LoRA parameters exclusively to image tokens to preserve the integrity of pre-trained language knowledge, striking a balance between precise vision understanding and text composition with literary talent. Experimental results demonstrate the superiority of InternLM-XComposer2 based on InternLM2-7B in producing high-quality long-text multi-modal content and its exceptional vision-language understanding performance across various benchmarks, where it not only significantly outperforms existing multimodal models but also matches or even surpasses GPT-4V and Gemini Pro in certain assessments. This highlights its remarkable proficiency in the realm of multimodal understanding. The InternLM-XComposer2 model series with 7B parameters are publicly available at https://github.com/InternLM/InternLM-XComposer.


title: Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation

abstract: In this work, we leverage the intrinsic segmentation of language sequences and design a new positional encoding method called Bilevel Positional Encoding (BiPE). For each position, our BiPE blends an intra-segment encoding and an inter-segment encoding. The intra-segment encoding identifies the locations within a segment and helps the model capture the semantic information therein via absolute positional encoding. The inter-segment encoding specifies the segment index, models the relationships between segments, and aims to improve extrapolation capabilities via relative positional encoding. Theoretical analysis shows this disentanglement of positional information makes learning more effective. The empirical results also show that our BiPE has superior length extrapolation capabilities across a wide range of tasks in diverse text modalities.


title: Strategic Usage in a Multi-Learner Setting

abstract: Real-world systems often involve some pool of users choosing between a set of services. With the increase in popularity of online learning algorithms, these services can now self-optimize, leveraging data collected on users to maximize some reward such as service quality. On the flipside, users may strategically choose which services to use in order to pursue their own reward functions, in the process wielding power over which services can see and use their data. Extensive prior research has been conducted on the effects of strategic users in single-service settings, with strategic behavior manifesting in the manipulation of observable features to achieve a desired classification; however, this can often be costly or unattainable for users and fails to capture the full behavior of multi-service dynamic systems. As such, we analyze a setting in which strategic users choose among several available services in order to pursue positive classifications, while services seek to minimize loss functions on their observations. We focus our analysis on realizable settings, and show that naive retraining can still lead to oscillation even if all users are observed at different times; however, if this retraining uses memory of past observations, convergent behavior can be guaranteed for certain loss function classes. We provide results obtained from synthetic and real-world data to empirically validate our theoretical findings.


title: Synchformer: Efficient Synchronization from Sparse Cues

abstract: Our objective is audio-visual synchronization with a focus on 'in-the-wild' videos, such as those on YouTube, where synchronization cues can be sparse. Our contributions include a novel audio-visual synchronization model, and training that decouples feature extraction from synchronization modelling through multi-modal segment-level contrastive pre-training. This approach achieves state-of-the-art performance in both dense and sparse settings. We also extend synchronization model training to AudioSet a million-scale 'in-the-wild' dataset, investigate evidence attribution techniques for interpretability, and explore a new capability for synchronization models: audio-visual synchronizability.


title: Computer Vision for Primate Behavior Analysis in the Wild

abstract: Advances in computer vision as well as increasingly widespread video-based behavioral monitoring have great potential for transforming how we study animal cognition and behavior. However, there is still a fairly large gap between the exciting prospects and what can actually be achieved in practice today, especially in videos from the wild. With this perspective paper, we want to contribute towards closing this gap, by guiding behavioral scientists in what can be expected from current methods and steering computer vision researchers towards problems that are relevant to advance research in animal behavior. We start with a survey of the state-of-the-art methods for computer vision problems that are directly relevant to the video-based study of animal behavior, including object detection, multi-individual tracking, (inter)action recognition and individual identification. We then review methods for effort-efficient learning, which is one of the biggest challenges from a practical perspective. Finally, we close with an outlook into the future of the emerging field of computer vision for animal behavior, where we argue that the field should move fast beyond the common frame-by-frame processing and treat video as a first-class citizen.


title: Analog Circuit Sizing Using Machine Learning Based Transistor Circuit Model

abstract: In this work, a new method for designing an analog circuit for deep sub-micron CMOS fabrication processes is proposed. The proposed method leverages the regression algorithms with the transistor circuit model to size a transistor in 0.18 um technology fast and without using simulation software. Threshold voltage, output resistance, and the product of mobility and oxide capacitance are key parameters in the transistor circuit model to size a transistor. For nano-scale transistors, however, these parameters are nonlinear with respect to electrical and physical characteristics of transistors and circuit simulator is needed to find the value of these parameters and therefore the design time increases. Regression analysis is utilized to predict values of these parameters. We demonstrate the performance of the proposed method by designing a Current Feedback Instrumentational Amplifier (CFIA). We show that the presented method accomplishes higher than 90% accuracy in predicting the desired value of W. It reduces the design time over 97% compared to conventional methods. The designed circuit using the proposed method consumes 5.76 uW power and has a Common Mode Rejection Ratio (CMRR) of 35.83 dB and it results in achieving 8.17 V/V gain.


title: Informal Safety Guarantees for Simulated Optimizers Through Extrapolation from Partial Simulations

abstract: Self-supervised learning is the backbone of state of the art language modeling. It has been argued that training with predictive loss on a self-supervised dataset causes simulators: entities that internally represent possible configurations of real-world systems. Under this assumption, a mathematical model for simulators is built based in the Cartesian frames model of embedded agents, which is extended to multi-agent worlds through scaling a two-dimensional frame to arbitrary dimensions, where literature prior chooses to instead use operations on frames. This variant leveraging scaling dimensionality is named the Cartesian object, and is used to represent simulations (where individual simulacra are the agents and devices in that object). Around the Cartesian object, functions like token selection and simulation complexity are accounted for in formalizing the behavior of a simulator, and used to show (through the L\"obian obstacle) that a proof of alignment between simulacra by inspection of design is impossible in the simulator context. Following this, a scheme is proposed and termed Partial Simulation Extrapolation aimed at circumventing the L\"obian obstacle through the evaluation of low-complexity simulations.


title: Mitigating Position Bias with Regularization for Recommender Systems

abstract: Fairness is a popular research topic in recent years. A research topic closely related to fairness is bias and debiasing. Among different types of bias problems, position bias is one of the most widely encountered symptoms. Position bias means that recommended items on top of the recommendation list has a higher likelihood to be clicked than items on bottom of the same list. To mitigate this problem, we propose to use regularization technique to reduce the bias effect. In the experiment section, we prove that our method is superior to other modern algorithms.


title: A Comparative Investigation into the Operation of an Optimal Control Problem: The Maximal Stretch

abstract: Mathematical Selection is a method in which we select a particular choice from a set of such. It have always been an interesting field of study for mathematicians. Combinatorial optimisation is the practice of selecting the best constituent from a collection of prospective possibilities according to some particular characterization. In simple cases, an optimal process problem encompasses identifying components out of a finite arrangement and establishing the function's significance in possible to lessen or achieve maximum with a functional purpose. To extrapolate optimisation theory, it employs a wide range of mathematical concepts. Optimisation, when applied to a variety of different types of optimization algorithms, necessitates determining the best consequences of the specific predetermined characteristic in a particular circumstance. In this work, we will be working on one similar problem - The Maximal Stretch Problem with computational rigour. Beginning with the Problem Statement itself, we will be developing numerous step - by - step algorithms to solve the problem, and will finally pose a comparison between them on the basis of their Computational Complexity. The article entails around the Brute Force Solution, A Recursive Approach to deal with the problem, and finally a Dynamically Programmed Approach for the same.