title: An experience in automatically extracting CAPAs from code repositories

abstract: TOM (stands for Theoretically Objective Measurements of Software Development Projects) is a set of services that are in charge of helping developers or teams in the process of identifying anomilies within their software development process, and providing a list of preventive or corrective actions (aka CAPAS) that positively impact the process. and in this way to improve the quality of the final product and its development process. In order to get help from TOM, it is as simple as adding our bot (@0capa) to the list of collaborators in your repository, and with this our bot will automatically take care of obtaining different metrics from your repository, in order to suggest actions to take into account to that in your future updates the identified anomalies are not repeated. This paper presents the underlying research on this idea.


title: A Physically-Consistent Chemical Dataset for the Simulation of N$_2$-CH$_4$ Shocked Flows Up to T=100,000K

abstract: In the previous work carried out in the scope of the \emph{Validation of Aerothermochemistry Models for Re-Entry Applications}, it was verified that the G\"{o}k\c{c}en chemical dataset provided increasingly diverging results from experiments, as one considered shock speeds in excess of 5\kilo\metre\per\second. Namely, for shock velocities between 7 and 9\kilo\metre\per\second, more than one temporal peak in CN Violet radiation were predicted by models considering this kinetic dataset, in contradiction with experiments. This hinted at several of the rates from the dataset not being directly applicable in the temperature range of interest for such applications, often in excess of 10,000\kelvin. Indeed, it has been found that several macroscopic rates from the G\"{o}k\c{c}en chemical dataset reached unphysical values at very high temperatures. Furthermore, many of the ionization rates have been found to be inadequate for the simulation of high-temperature N$_{2}$--CH$_{4}$ shocked flows. Here, we have carried an extensive update of the G\"{o}k\c{c}en chemical dataset, with the aim of at least reaching physically consistent rates for the whole T=100-100,000\kelvin\ temperature range. While it cannot really be claimed that such improved dataset is validated in such an extended temperature range (due to the scarcely available experimental data for such high temperature ranges), it is capable of providing more accurate simulations of high-speed shocked flows for this mixture, when compared to the G\"{o}k\c{c}en chemical dataset.


title: Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks

abstract: Generative models have been widely applied to solve extractive tasks, where parts of the input is extracted to form the desired output, and achieved significant success. For example, in extractive question answering (QA), generative models have constantly yielded state-of-the-art results. In this work, we identify the issue of tokenization inconsistency that is commonly neglected in training these models. This issue damages the extractive nature of these tasks after the input and output are tokenized inconsistently by the tokenizer, and thus leads to performance drop as well as hallucination. We propose a simple yet effective fix to this issue and conduct a case study on extractive QA. We show that, with consistent tokenization, the model performs better in both in-domain and out-of-domain datasets, with a notable average of +1.7 F2 gain when a BART model is trained on SQuAD and evaluated on 8 QA datasets. Further, the model converges faster, and becomes less likely to generate out-of-context answers. With these findings, we would like to call for more attention on how tokenization should be done when solving extractive tasks and recommend applying consistent tokenization during training.


title: Dynamical approach to the jamming problem

abstract: A simple dynamical model, Biased Random Organization, BRO, appears to produce configurations known as Random Close Packing (RCP) as BRO's densest critical point in dimension $d=3$. We conjecture that BRO likewise produces RCP in any dimension; if so, then RCP does not exist in $d=1-2$ (where BRO dynamics lead to crystalline order). In $d=3-5$, BRO produces isostatic configurations and previously estimated RCP volume fractions 0.64, 0.46, and 0.30, respectively. For all investigated dimensions ($d=2-5$), we find that BRO belongs to the Manna universality class of dynamical phase transitions by measuring critical exponents associated with the steady-state activity and the long-range density fluctuations. Additionally, BRO's distribution of near-contacts (gaps) displays behavior consistent with the infinite-dimensional theoretical treatment of RCP when $d \ge 4$. The association of BRO's densest critical configurations with Random Close Packing implies that RCP's upper-critical dimension is consistent with the Manna class $d_{uc} = 4$.


title: Eikonal Equation 0.1

abstract: We provide a review of some symmetry-related literature on the eikonal equations $u_\mu u_\mu =0$,$u_\mu u_\mu =1$, where lower indices at dependent variables designate derivatives, $\mu=0,1,2,..,n$ and summation is implied over the repeated indices. We will consider general solutions and symmetries of these equations, and relations of these equations with the reduction of higher-order PDE. Some new results that were needed for the comprehensive presentation are also adduced. In particular, we will also consider discrete symmetries of the eikonal equations equivalence classes of solutions and relations of the symmetry solutions and the general solutions. We describe in detail the procedure that allowed obtaining of the general solution using hodograph and contact transformations of the initial equations. Some new results by the author that were needed for comprehensive presentation are also adduced - in particular, a general solution of the eikonal equation for an arbitrary number of space variables. The paper is intended both as reference material and as a manual.


title: Quantum simulation of the generalized-entangled quantum eraser and the related complete complementarity relations

abstract: We utilize IBM's quantum computers to perform a full quantum simulation of the optical quantum eraser (QE) utilizing a Mach-Zehnder interferometer with a variable partially-polarizing beam splitter (VPPBS) at the input. The use of the VPPBS motivates us to introduce the entangled quantum eraser, for which the path information is erased using a Bell-basis measurement. We also investigate the behavior of the wave aspect, i.e., the quantum coherence, as well as the particle character, represented by the predictability and entanglement, as delineated in complete complementarity relations (CCRs). As we show in this article, the utilization of the VPPBS uncover interesting aspects of the QE and CCRs. For instance, we can recover the full wave-behavior by the erasure procedure even when we have only partial knowledge about the path through entanglement.


title: QCD thermodynamics with stabilized Wilson fermions

abstract: Stabilized Wilson fermions are a reformulation of Wilson clover fermions that incorporates several numerical stabilizing techniques, but also a local change of the fermion action - the original clover term being replaced with an exponentiated version of it. We intend to apply the stabilized Wilson fermions toolbox to the thermodynamics of QCD, starting on the $N_f=3$ symmetric line on the Columbia plot, and to compare the results with those obtained with other fermion discretizations.


title: Inverse Reinforcement Learning for Text Summarization

abstract: We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important sub-rewards for summarization and concurrently optimizes the policy network. Experimental results across datasets in different domains (CNN/DailyMail and WikiHow) and various model sizes (BART-base and BART-large) demonstrate the superiority of our proposed IRL model for summarization over MLE and RL baselines. The resulting summaries exhibit greater similarity to human-crafted gold references, outperforming MLE and RL baselines on metrics such as ROUGE, coverage, novelty, compression ratio, factuality, and human evaluations.


title: Generalizing Multimodal Variational Methods to Sets

abstract: Making sense of multiple modalities can yield a more comprehensive description of real-world phenomena. However, learning the co-representation of diverse modalities is still a long-standing endeavor in emerging machine learning applications and research. Previous generative approaches for multimodal input approximate a joint-modality posterior by uni-modality posteriors as product-of-experts (PoE) or mixture-of-experts (MoE). We argue that these approximations lead to a defective bound for the optimization process and loss of semantic connection among modalities. This paper presents a novel variational method on sets called the Set Multimodal VAE (SMVAE) for learning a multimodal latent space while handling the missing modality problem. By modeling the joint-modality posterior distribution directly, the proposed SMVAE learns to exchange information between multiple modalities and compensate for the drawbacks caused by factorization. In public datasets of various domains, the experimental results demonstrate that the proposed method is applicable to order-agnostic cross-modal generation while achieving outstanding performance compared to the state-of-the-art multimodal methods. The source code for our method is available online https://anonymous.4open.science/r/SMVAE-9B3C/.


title: Generating Functions for Asymmetric Random Walk Processes With Double Absorbing Barriers

abstract: Generating functions for asymmetric step-size paths restricted by two absorbing barriers are derived. The method begins by applying the Lagrange inversion formula to arbitrary powers of roots of the characteristic equation, that being a trinomial, which produces generating function as function (z) of the conditional probability of absorption of a particle, on a path restricted by two absorbing barriers. The exact enumeration of an asymmetric walk with two absorbing barriers is given.


title: Variational Factorization Machines for Preference Elicitation in Large-Scale Recommender Systems

abstract: Factorization machines (FMs) are a powerful tool for regression and classification in the context of sparse observations, that has been successfully applied to collaborative filtering, especially when side information over users or items is available. Bayesian formulations of FMs have been proposed to provide confidence intervals over the predictions made by the model, however they usually involve Markov-chain Monte Carlo methods that require many samples to provide accurate predictions, resulting in slow training in the context of large-scale data. In this paper, we propose a variational formulation of factorization machines that allows us to derive a simple objective that can be easily optimized using standard mini-batch stochastic gradient descent, making it amenable to large-scale data. Our algorithm learns an approximate posterior distribution over the user and item parameters, which leads to confidence intervals over the predictions. We show, using several datasets, that it has comparable or better performance than existing methods in terms of prediction accuracy, and provide some applications in active learning strategies, e.g., preference elicitation techniques.


title: Input Normalized Stochastic Gradient Descent Training of Deep Neural Networks

abstract: In this paper, we propose a novel optimization algorithm for training machine learning models called Input Normalized Stochastic Gradient Descent (INSGD), inspired by the Normalized Least Mean Squares (NLMS) algorithm used in adaptive filtering. When training complex models on large datasets, the choice of optimizer parameters, particularly the learning rate, is crucial to avoid divergence. Our algorithm updates the network weights using stochastic gradient descent with $\ell_1$ and $\ell_2$-based normalizations applied to the learning rate, similar to NLMS. However, unlike existing normalization methods, we exclude the error term from the normalization process and instead normalize the update term using the input vector to the neuron. Our experiments demonstrate that our optimization algorithm achieves higher accuracy levels compared to different initialization settings. We evaluate the efficiency of our training algorithm on benchmark datasets using ResNet-18, WResNet-20, ResNet-50, and a toy neural network. Our INSGD algorithm improves the accuracy of ResNet-18 on CIFAR-10 from 92.42\% to 92.71\%, WResNet-20 on CIFAR-100 from 76.20\% to 77.39\%, and ResNet-50 on ImageNet-1K from 75.52\% to 75.67\%.


title: On the cohomology of the ramified PEL unitary Rapoport-Zink space of signature $(1,n-1)$

abstract: In this paper, we study the cohomology of the ramified PEL unitary Rapoport-Zink space of signature $(1,n-1)$ by using the Bruhat-Tits stratification on its special fiber. As such, we apply the same method that we developped for the unramified case in two previous papers. More precisely, we first investigate the cohomology of a given closed Bruhat-Tits stratum. It is isomorphic to a generalized Deligne-Lusztig variety which is in general not smooth, and is associated to a finite group of symplectic similitudes. We determine the weights of the Frobenius and most of the unipotent representations occuring in its cohomology. This computation involves the spectral sequence associated to a stratification by classical Deligne-Lusztig varieties, which are parabolically induced from Coxeter varieties of smaller symplectic groups. In particular, all the unipotent representations contribute to only two cuspidal series. Then, we introduce the analytical tubes of the closed Bruhat-Tits strata, which give an open cover of the generic fiber of the Rapoport-Zink space. Using the associated \v{C}ech spectral sequence, we prove that certain cohomology groups of the Rapoport-Zink space at hyperspecial level fail to be admissible if $n$ is large enough. Eventually, when $n=2$ in the split case, when $n=3$ and when $n=4$ in the non-split case, we give a complete description of the cohomology of the supersingular locus of the associated Shimura variety at hyperspecial level, in terms of automorphic representations. In particular, certain automorphic representations occur with a multiplicity depending on $p$. Thus, our computations in the ramified case recover all the main features of the unramified case, despite new technical difficulties due to the closed Bruhat-Tits strata not being smooth.


title: The Role of RNA Condensation in Reducing Gene Expression Noise

abstract: Biomolecular condensates have been shown to play a fundamental role in localizing biochemistry in a cell. RNA is a common constituent of condensates, and can determine their biophysical properties. Functions of biomolecular condensates are varied including activating, inhibiting, and localizing reactions. Recent theoretical work has shown that the phase separation of proteins into droplets can diminish cell to cell variability in protein abundance. However, the extent to which phase separation involving mRNAs may also buffer noise has yet to be explored. In this paper, we introduce a phenomenological model for the phase separation of mRNAs into RNP condensates, and quantify noise suppression as a function of gene expression kinetic parameters. Through stochastic simulations, we highlight the ability for condensates formed from just a handful of mRNAs to regulate the abundance and suppress the fluctuations of proteins. We place particular emphasis on how this mechanism can facilitate efficient transcription by reducing noise even in the situation of infrequent bursts of transcription by exploiting the physics of a concentration-dependent, deterministic phase separation threshold. We investigate two biologically relevant models in which phase separation acts to either "buffer" noise by storing mRNA in inert droplets, or "filter" phase separated mRNAs by accelerating their decay, and quantify expression noise as a function of kinetic parameters. In either case the most efficient expression occurs when bursts produce mRNAs close the phase separation threshold, which we find to be broadly consistent with observations of an RNP-droplet forming cyclinin multinucleate Ashbya gossypii cells. We finally consider the contribution of noise in the phase separation threshold, and show that protein copy number noise can be suppressed by phase separation threshold fluctuations in certain conditions.


title: Generating the mapping class group of a non-orientable punctured surface by involutions

abstract: Let $N_{g,n}$ denote the closed non-orientable surface of genus $g$ with $n$ punctures and let ${\mathcal N}_{g,n}$ denote the mapping class group of $N_{g,n}$. Szepietowski showed that ${\mathcal N}_{g,n}$ is generated by finitely many involutions. The number of elements in his generating set depends linearly on $g$ and $n$. In the case of $n=0$, Szepietowski found an involution generating set in such a way that the number of its elements does not depend on $g$, showing that ${\mathcal N}_{g,0}$ is generated by four involutions. In this thesis, for $n \geq 0$, we prove that ${\mathcal N}_{g,n}$ is generated by eight involutions if $g \geq 13$ is odd and by eleven involutions if $g \geq 14$ is even.


title: Plug & Play Directed Evolution of Proteins with Gradient-based Discrete MCMC

abstract: A long-standing goal of machine-learning-based protein engineering is to accelerate the discovery of novel mutations that improve the function of a known protein. We introduce a sampling framework for evolving proteins in silico that supports mixing and matching a variety of unsupervised models, such as protein language models, and supervised models that predict protein function from sequence. By composing these models, we aim to improve our ability to evaluate unseen mutations and constrain search to regions of sequence space likely to contain functional proteins. Our framework achieves this without any model fine-tuning or re-training by constructing a product of experts distribution directly in discrete protein space. Instead of resorting to brute force search or random sampling, which is typical of classic directed evolution, we introduce a fast MCMC sampler that uses gradients to propose promising mutations. We conduct in silico directed evolution experiments on wide fitness landscapes and across a range of different pre-trained unsupervised models, including a 650M parameter protein language model. Our results demonstrate an ability to efficiently discover variants with high evolutionary likelihood as well as estimated activity multiple mutations away from a wild type protein, suggesting our sampler provides a practical and effective new paradigm for machine-learning-based protein engineering.


title: Bandit approach to conflict-free multi-agent Q-learning in view of photonic implementation

abstract: Recently, extensive studies on photonic reinforcement learning to accelerate the process of calculation by exploiting the physical nature of light have been conducted. Previous studies utilized quantum interference of photons to achieve collective decision-making without choice conflicts when solving the competitive multi-armed bandit problem, a fundamental example of reinforcement learning. However, the bandit problem deals with a static environment where the agent's action does not influence the reward probabilities. This study aims to extend the conventional approach to a more general multi-agent reinforcement learning targeting the grid world problem. Unlike the conventional approach, the proposed scheme deals with a dynamic environment where the reward changes because of agents' actions. A successful photonic reinforcement learning scheme requires both a photonic system that contributes to the quality of learning and a suitable algorithm. This study proposes a novel learning algorithm, discontinuous bandit Q-learning, in view of a potential photonic implementation. Here, state-action pairs in the environment are regarded as slot machines in the context of the bandit problem and an updated amount of Q-value is regarded as the reward of the bandit problem. We perform numerical simulations to validate the effectiveness of the bandit algorithm. In addition, we propose a multi-agent architecture in which agents are indirectly connected through quantum interference of light and quantum principles ensure the conflict-free property of state-action pair selections among agents. We demonstrate that multi-agent reinforcement learning can be accelerated owing to conflict avoidance among multiple agents.


title: Generation and Applications of strong THz Fields driven by intense mid-IR Pulses

abstract: Although the THz spectral range experiences a tremendous grow of interest for at least two decades, it is still one of the least explored but most exciting areas to study light-matter interaction. Due to the small photon energy of THz radiation, it can propagate through non-conductive materials and resonantly interact with low-energy excitations, leading to a plethora of applications. The THz pulse is thereby primarily used as a probe while an optical pulse excites the material that is examined. In contrast, intense strong-field THz transients would allow on-demand control of the properties of matter. Current table-top THz sources remain rather weak, with the most promising being optical rectification (OR) in nonlinear crystals and two-color plasma filaments pumped by near-IR sources. While the former is mainly restricted by multi-photon absorption of the short wavelength driving pulse, causing crystal damage, the latter suffers from pump pulse scattering in dense plasma and limited laser field-asymmetry. These limitations can be surpassed with intense long wavelength driving pulses. Until recently, such high-power mid-IR sources were simply not available. In this work, we exploit the recently developed mid-IR optical parametric chirped pulse amplifier system to drive efficient THz generation in the organic crystal DAST by OR and in two-color plasma filaments, wherein we boost the optical- to THz conversion efficiency by almost an order of magnitude, compared to previous works with near-IR drivers. The intense THz source is further applied to heterostructure quantum dots without any field enhancing structures to investigate the pure quantum confined Stark effect. The possibility to manipulate optical properties of nano-scale semiconductors by direct THz radiation demonstrates the feasibility for an all-optical electro-absorption modulator with data rates in the range of Tbit/s.


title: Improving the Robustness of Summarization Models by Detecting and Removing Input Noise

abstract: The evaluation of abstractive summarization models typically uses test data that is identically distributed as training data. In real-world practice, documents to be summarized may contain input noise caused by text extraction artifacts or data pipeline bugs. The robustness of model performance under distribution shift caused by such noise is relatively under-studied. We present a large empirical study quantifying the sometimes severe loss in performance (up to 12 ROUGE-1 points) from different types of input noise for a range of datasets and model sizes. We then propose a light-weight method for detecting and removing such noise in the input during model inference without requiring any extra training, auxiliary models, or even prior knowledge of the type of noise. Our proposed approach effectively mitigates the loss in performance, recovering a large fraction of the performance drop, sometimes as large as 11 ROUGE-1 points.


title: H2 Model Order Reduction: A Relative Error Setting

abstract: In dynamical system theory, the process of obtaining a reduced-order approximation of the high-order model is called model order reduction. The closeness of the reduced-order model to the original model is generally gauged by using system norms of additive or relative error system. The relative error is a superior criterion to the additive error in assessing accuracy in many applications like reduced-order controller and filter designs. In this paper, we propose an oblique projection algorithm that minimizes the H2 norm of the relative error transfer function. The selection of reduction matrices in the algorithm is motivated by the necessary conditions for local optima of the (squared) H2 norm of the relative error transfer function. Numerical simulation confirms that the proposed algorithm compares well in accuracy with balanced stochastic truncation while avoiding the solution of large-scale Riccati and Lyapunov equations.


title: Frequency-limited H$_2$ Model Order Reduction Based on Relative Error

abstract: Frequency-limited model order reduction aims to approximate a high-order model with a reduced-order model that maintains high fidelity within a specific frequency range. Beyond this range, a decrease in accuracy is acceptable due to the nature of the problem. The quality of the reduced-order model is typically evaluated using absolute or relative measures of approximation error. Relative error, which represents the percentage error, becomes particularly relevant when reducing a plant model for the purpose of designing a reduced-order controller. This paper derives the necessary conditions for achieving a local optimum of the frequency-limited H2 norm for the relative error system. Based on these optimality conditions, an oblique projection algorithm is proposed to ensure a small relative error within the desired frequency interval. Unlike existing algorithms, the proposed approach does not necessitate solving large-scale Lyapunov and Ricatti equations. Instead, the proposed algorithm relies on solving sparse-dense Sylvester equations, which typically emerge in the majority of H2 model order reduction algorithms, but can be efficiently solved. To evaluate the performance of the proposed algorithm, a comparison is conducted with three existing techniques: frequency-limited balanced truncation, frequency-limited balanced stochastic truncation, and frequency-limited iterative Rational Krylov algorithm. The comparative analysis focuses on designing reduced-order controllers for high-order plants. Numerical results confirm that the reduced-order controllers obtained using the proposed algorithm ensure superior robust closed-loop stability.


title: A Generalized Variable Importance Metric and Estimator for Black Box Machine Learning Models

abstract: In this paper we define a population parameter, ``Generalized Variable Importance Metric (GVIM)'', to measure importance of predictors for black box machine learning methods, where the importance is not represented by model-based parameter. GVIM is defined for each input variable, using the true conditional expectation function, and it measures the variable's importance in affecting a continuous or a binary response. We extend previously published results to show that the defined GVIM can be represented as a function of the Conditional Average Treatment Effect (CATE) for any kind of a predictor, which gives it a causal interpretation and further justification as an alternative to classical measures of significance that are only available in simple parametric models. Extensive set of simulations using realistically complex relationships between covariates and outcomes and number of regression techniques of varying degree of complexity show the performance of our proposed estimator of the GVIM.


title: Newtonian Fractional-Dimension Gravity and Galaxies without Dark Matter

abstract: We apply Newtonian Fractional-Dimension Gravity (NFDG), an alternative gravitational model, to some notable cases of galaxies with little or no dark matter. In the case of the ultra-diffuse galaxy AGC 114905, we show that NFDG methods can effectively reproduce the observed rotation curve, by using a variable fractional dimension $D\left (R\right )$ as was done for other galaxies in previous studies. For AGC 114905, we obtain a variable dimension in the range $D \approx 2.2 -3.2$, but our fixed $D =3$ curve can still fit all the experimental data within their error bars. This confirms other studies indicating that the dynamics of this galaxy can be described almost entirely by the baryonic mass distribution alone. However, our NFDG model explains the residual discrepancies without using any dark matter component. In the case of NGC 1052-DF2, we use an argument based on the NFDG extension of the virial theorem applied to the velocity dispersion of globular clusters showing that, in general, discrepancies between observed and predicted velocity dispersions can be attributed to an overall fractal dimension $D <3$ of the astrophysical structure considered and not to the presence of dark matter. For NGC 1052-DF2 we estimate $D \approx 2.9$, thus confirming that this galaxy almost follows standard Newtonian behavior. We also consider the case of the Bullet Cluster merger (1E0657-56), assumed to be one of the strongest proofs of dark matter existence. A simplified but effective NFDG model of the collision shows that the observed infall velocity of this merger can be explained by a fractional dimension of the system in the range $D \simeq 2.4 -2.5$, again without using any dark matter.


title: Hidden Variables for Pauli Measurements

abstract: The Pauli measurements (the measurements that can be performed with Clifford operators followed by measurement in the computational basis) are a fundamental object in quantum information. It is well-known that there is no assignment of outcomes to all Pauli measurements that is both complete and consistent. We define two classes of hidden variable assignments based on relaxing either condition. Partial hidden variable assignments retain the consistency condition, but forfeit completeness. Contextual hidden variable assignments retain completeness but forfeit consistency. We use techniques from spectral graph theory to characterize the incompleteness and inconsistency of the respective hidden variable assignments. As an application, we interpret our incompleteness result as a statement of contextuality and our inconsistency result as a statement of nonlocality. Our results show that we can obtain large amounts of contextuality and nonlocality using Clifford gates and measurements.


title: Rationality of vertex operator superalgebras with rational conformal weights

abstract: For the affine vertex algebra $V_k(\mathfrak{g})$ at an admissible level $k$ of $\hat{\mathfrak{g}}$, we prove that certain subcategory of weak $V_k(\mathfrak{g})$-module category is semisimple. As a consequence, we show that $V_k(\mathfrak{g})$ is rational with respect to a family of Virasoro elements. We also prove that certain affine vertex operator superalgebras and minimal $W$-algebras are rational with respect to a family of Virasoro elements.


title: Approaching the Quantum Singleton Bound with Approximate Error Correction

abstract: It is well known that no quantum error correcting code of rate $R$ can correct adversarial errors on more than a $(1-R)/4$ fraction of symbols. But what if we only require our codes to *approximately* recover the message? We construct efficiently-decodable approximate quantum codes against adversarial error rates approaching the quantum Singleton bound of $(1-R)/2$, for any constant rate $R$. Moreover, the size of the alphabet is a constant independent of the message length and the recovery error is exponentially small in the message length. Central to our construction is a notion of quantum list decoding and an implementation involving folded quantum Reed-Solomon codes.


title: Validation of the Quantum Physics Processes Underlying the Integrated Optimization of Proton FLASH Radiotherapy

abstract: FLASH is a new treatment modality that requires optimization of dose, dose rate, and LET. Here we validate these three quantities under FLASH conditions, which includes the quantum uncertainty in the time-dependent instantaneous dose rate (IDR) curves and LET spectra that underlie the newly proposed integrated optimization framework. Measurements of dose, IDR, and LET were performed at the Emory Proton Therapy Center using a FLASH proton beam with a nominal energy of 250 MeV and a 3D printed ridge filter. Because 3D printing resin is made from a proprietary chemical formula, we developed a method for realistically characterizing and modeling the material in simulations. Absolute dose in 3D space was measured using a 2D MatriXX PT detector as well as by a novel 4D multi-layer strip ionization chamber (MLSIC), which also simultaneously measures IDR. Further timing data was measured in the secondary beam by detecting prompt gammas using a Minipix Timepix3; a second detector, Advapix Timepix3, was used to measure LET. To account for the quantum mechanical nature of particle transport, we developed a technique for detecting individual protons within a high flux primary beam, which was necessary for properly measuring LET spectra. TOPAS simulations agreed with measurement, with absolute dose typically having a gamma passing rate of at least 95% (3 mm/3% criteria). Likewise, IDR and LET showed good agreement, with averaged IDR values agreeing within 0.3% with fluctuations on the order of 10%, and LET distributions overlapping by at least 85% and showing an increase in high LET components (greater than 4 keV/um) with increasing depth. As LET and FLASH optimization continues to grow in popularity, measuring IDR, LET, and dose will become even more important, and we expect that the methods described here will prove to be useful tools in radiotherapy treatment planning and QA.


title: AI applications in forest monitoring need remote sensing benchmark datasets

abstract: With the rise in high resolution remote sensing technologies there has been an explosion in the amount of data available for forest monitoring, and an accompanying growth in artificial intelligence applications to automatically derive forest properties of interest from these datasets. Many studies use their own data at small spatio-temporal scales, and demonstrate an application of an existing or adapted data science method for a particular task. This approach often involves intensive and time-consuming data collection and processing, but generates results restricted to specific ecosystems and sensor types. There is a lack of widespread acknowledgement of how the types and structures of data used affects performance and accuracy of analysis algorithms. To accelerate progress in the field more efficiently, benchmarking datasets upon which methods can be tested and compared are sorely needed. Here, we discuss how lack of standardisation impacts confidence in estimation of key forest properties, and how considerations of data collection need to be accounted for in assessing method performance. We present pragmatic requirements and considerations for the creation of rigorous, useful benchmarking datasets for forest monitoring applications, and discuss how tools from modern data science can improve use of existing data. We list a set of example large-scale datasets that could contribute to benchmarking, and present a vision for how community-driven, representative benchmarking initiatives could benefit the field.


title: Relating Peak Optical Luminosity and Orbital Period of Stellar-Mass Black Holes in X-ray Binaries

abstract: We compare the peak optical luminosity with the orbital period for a sample of 22 stellar-mass black hole candidates with good measurements of both quantities. We find that the peak absolute magnitude for the outbursts follows a linear relation with $M_{V,peak}=3.48 (\pm 0.85)-3.89 (\pm 0.91) {\rm log}P_{orb}$, which corresponds to a $L_V \propto P_{orb}^{1.56\pm 0.36}$ power law relation. Excluding V4641 Sgr which is a strong outlier and not likely to have outbursts produced by the standard disc instability model, in addition to BW Cir and V821 Ara -- both of which have highly uncertain distances; the new correlation for the 19 sources is found to be $M_{V,peak}= 3.01\;(\pm 0.93)-3.21\;(\pm 1.04){\rm log}P_{orb}$, which corresponds to $L_V \propto P_{orb}^{1.28 \pm 0.42}$. This is an analogous relationship to the "Warner relation" between orbital period and peak luminosity found for cataclysmic variables. We discuss the implications of these results for finding black hole X-ray binaries in other galaxies and in our own Galaxy with the Large Synoptic Survey Telescope and other future large time domain surveys.


title: AnyTOD: A Programmable Task-Oriented Dialog System

abstract: We propose AnyTOD, an end-to-end, zero-shot task-oriented dialog (TOD) system capable of handling unseen tasks without task-specific training. We view TOD as a program executed by a language model (LM), where program logic and ontology is provided by a designer as a schema. To enable generalization to unseen schemas and programs without prior training, AnyTOD adopts a neuro-symbolic approach. A neural LM keeps track of events occurring during a conversation and a symbolic program implementing the dialog policy is executed to recommend next actions AnyTOD should take. This approach drastically reduces data annotation and model training requirements, addressing the enduring challenge of rapidly adapting a TOD system to unseen tasks and domains. We demonstrate state-of-the-art results on STAR, ABCD and SGD benchmarks. We also demonstrate strong zero-shot transfer ability in low-resource settings, such as zero-shot on MultiWOZ. In addition, we release STARv2, an updated version of the STAR dataset with richer annotations, for benchmarking zero-shot end-to-end TOD models.


title: Mass and isovector matrix elements of the nucleon at zero-momentum transfer

abstract: We present the current status of our analysis of nucleon structure observables including isovector charges and twist-2 matrix elements as well as the nucleon mass. Results are computed on a large set of CLS $N_f=2+1$ gauge ensembles with $M_\pi\approx0.130\mathrm{MeV}\ldots 350\mathrm{MeV}$, four values of the lattice spacing $a=0.05\mathrm{fm}\ldots 0.09\mathrm{fm}$ and covering a large range of physical volumes. Compared to the results presented at last year's conference we have added data on a very fine and large box at small light quark mass ($T\times L^3=192 \times 96^3$, $M_\pi=172\mathrm{MeV}$, $a=0.05\mathrm{fm}$). Additional (intermediate) source-sink separations have been computed on the coarser ensembles, further increasing effective statistics and allowing for a more fine-grained control in the treatment of the excited-state contamination. Excited states in the nucleon matrix elements are tamed by a simultaneous, two-state fit ansatz using the summation method.


title: Anticipatory Fictitious Play

abstract: Fictitious play is an algorithm for computing Nash equilibria of matrix games. Recently, machine learning variants of fictitious play have been successfully applied to complicated real-world games. This paper presents a simple modification of fictitious play which is a strict improvement over the original: it has the same theoretical worst-case convergence rate, is equally applicable in a machine learning context, and enjoys superior empirical performance. We conduct an extensive comparison of our algorithm with fictitious play, proving an optimal convergence rate for certain classes of games, demonstrating superior performance numerically across a variety of games, and concluding with experiments that extend these algorithms to the setting of deep multiagent reinforcement learning.


title: The Fenchel-Nielsen twist in terms of the cross ratio

abstract: We calculate the Fenchel-Nielsen twist in the enhanced Teichm\"uller space of a marked surface by the cross ratio coordinates.


title: Another remark on a result of Ding-Jost-Li-Wang

abstract: Let $(M,g)$ be a compact Riemann surface, $h$ be a positive smooth function on $M$. It is well known the functional $$J(u)=\frac{1}{2}\int_M|\nabla u|^2dv_g+8\pi\int_M udv_g-8\pi\log\int_Mhe^{u}dv_g$$ achieves its minimum under Ding-Jost-Li-Wang condition. This result was generalized to nonnegative $h$ by Yang and the author. Later, Sun and Zhu (arXiv:2012.12840) showed Ding-Jost-Li-Wang condition is also sufficient for $J$ achieves its minimum when $h$ changes sign, which was reproved later by Wang and Yang (J. Funct. Anal. 282: Paper No. 109449, 2022) and Li and Xu (Calc. Var. 61: Paper No. 143, 2022) respectively using flow approach. The aim of this note is to give a new proof of Sun and Zhu's result. Our proof is based on the variational method and the maximum principle.


title: Full-Life Cycle Intent-Driven Network Verification: Challenges and Approaches

abstract: With the human friendly declarative intent policy expression, intent-driven network can make network management and configuration autonomous without human intervention. However, the availability and dependability of these refined policies from the expressed intents should be well ensured by full-life cycle verification. Moreover, intent-driven network verification is still in its initial stage, and there is a lack of full-life cycle end-to-end verification framework. As a result, in this article, we present and review existing verification techniques, and classify them according to objective, purpose, and feedback. Furthermore, we describe intent verification as a technology that provides assurance during the intent form conversion process and propose a novel full-life cycle verification framework that expands on the concept of traditional network verification. Finally, we verify the feasibility and validity of the presented verification framework in the case of an access control policy for different network functions with multi conflict intents.


title: Robust and Resource-efficient Machine Learning Aided Viewport Prediction in Virtual Reality

abstract: 360-degree panoramic videos have gained considerable attention in recent years due to the rapid development of head-mounted displays (HMDs) and panoramic cameras. One major problem in streaming panoramic videos is that panoramic videos are much larger in size compared to traditional ones. Moreover, the user devices are often in a wireless environment, with limited battery, computation power, and bandwidth. To reduce resource consumption, researchers have proposed ways to predict the users' viewports so that only part of the entire video needs to be transmitted from the server. However, the robustness of such prediction approaches has been overlooked in the literature: it is usually assumed that only a few models, pre-trained on past users' experiences, are applied for prediction to all users. We observe that those pre-trained models can perform poorly for some users because they might have drastically different behaviors from the majority, and the pre-trained models cannot capture the features in unseen videos. In this work, we propose a novel meta learning based viewport prediction paradigm to alleviate the worst prediction performance and ensure the robustness of viewport prediction. This paradigm uses two machine learning models, where the first model predicts the viewing direction, and the second model predicts the minimum video prefetch size that can include the actual viewport. We first train two meta models so that they are sensitive to new training data, and then quickly adapt them to users while they are watching the videos. Evaluation results reveal that the meta models can adapt quickly to each user, and can significantly increase the prediction accuracy, especially for the worst-performing predictions.


title: Dialog2API: Task-Oriented Dialogue with API Description and Example Programs

abstract: Functionality and dialogue experience are two important factors of task-oriented dialogue systems. Conventional approaches with closed schema (e.g., conversational semantic parsing) often fail as both the functionality and dialogue experience are strongly constrained by the underlying schema. We introduce a new paradigm for task-oriented dialogue - Dialog2API - to greatly expand the functionality and provide seamless dialogue experience. The conversational model interacts with the environment by generating and executing programs triggering a set of pre-defined APIs. The model also manages the dialogue policy and interact with the user through generating appropriate natural language responses. By allowing generating free-form programs, Dialog2API supports composite goals by combining different APIs, whereas unrestricted program revision provides natural and robust dialogue experience. To facilitate Dialog2API, the core model is provided with API documents, an execution environment and optionally some example dialogues annotated with programs. We propose an approach tailored for the Dialog2API, where the dialogue states are represented by a stack of programs, with most recently mentioned program on the top of the stack. Dialog2API can work with many application scenarios such as software automation and customer service. In this paper, we construct a dataset for AWS S3 APIs and present evaluation results of in-context learning baselines.


title: Future Sight: Dynamic Story Generation with Large Pretrained Language Models

abstract: Recent advances in deep learning research, such as transformers, have bolstered the ability for automated agents to generate creative texts similar to those that a human would write. By default, transformer decoders can only generate new text with respect to previously generated text. The output distribution of candidate tokens at any position is conditioned on previously selected tokens using a self-attention mechanism to emulate the property of autoregression. This is inherently limiting for tasks such as controllable story generation where it may be necessary to condition on future plot events when writing a story. In this work, we propose Future Sight, a method for finetuning a pretrained generative transformer on the task of future conditioning. Transformer decoders are typically pretrained on the task of completing a context, one token at a time, by means of self-attention. Future Sight additionally enables a decoder to attend to an encoded future plot event. This motivates the decoder to expand on the context in a way that logically concludes with the provided future. During inference, the future plot event can be written by a human author to steer the narrative being generated in a certain direction. We evaluate the efficacy of our approach on a story generation task with human evaluators.


title: MM-3DScene: 3D Scene Understanding by Customizing Masked Modeling with Informative-Preserved Reconstruction and Self-Distilled Consistency

abstract: Masked Modeling (MM) has demonstrated widespread success in various vision challenges, by reconstructing masked visual patches. Yet, applying MM for large-scale 3D scenes remains an open problem due to the data sparsity and scene complexity. The conventional random masking paradigm used in 2D images often causes a high risk of ambiguity when recovering the masked region of 3D scenes. To this end, we propose a novel informative-preserved reconstruction, which explores local statistics to discover and preserve the representative structured points, effectively enhancing the pretext masking task for 3D scene understanding. Integrated with a progressive reconstruction manner, our method can concentrate on modeling regional geometry and enjoy less ambiguity for masked reconstruction. Besides, such scenes with progressive masking ratios can also serve to self-distill their intrinsic spatial consistency, requiring to learn the consistent representations from unmasked areas. By elegantly combining informative-preserved reconstruction on masked areas and consistency self-distillation from unmasked areas, a unified framework called MM-3DScene is yielded. We conduct comprehensive experiments on a host of downstream tasks. The consistent improvement (e.g., +6.1 mAP@0.5 on object detection and +2.2% mIoU on semantic segmentation) demonstrates the superiority of our approach.


title: Graphs of scramble number two

abstract: The scramble number of a graph provides a lower bound for gonality and an upper bound for treewidth, making it a graph invariant of interest. In this paper we study graphs of scramble number at most two, and give a classification of all such graphs with a finite list of forbidden topological minors. We then prove that there exists no finite list of forbidden topological minors to characterize graphs of any fixed scramble number greater than two.


title: Domain Generalization with Correlated Style Uncertainty

abstract: Domain generalization (DG) approaches intend to extract domain invariant features that can lead to a more robust deep learning model. In this regard, style augmentation is a strong DG method taking advantage of instance-specific feature statistics containing informative style characteristics to synthetic novel domains. While it is one of the state-of-the-art methods, prior works on style augmentation have either disregarded the interdependence amongst distinct feature channels or have solely constrained style augmentation to linear interpolation. To address these research gaps, in this work, we introduce a novel augmentation approach, named Correlated Style Uncertainty (CSU), surpassing the limitations of linear interpolation in style statistic space and simultaneously preserving vital correlation information. Our method's efficacy is established through extensive experimentation on diverse cross-domain computer vision and medical imaging classification tasks: PACS, Office-Home, and Camelyon17 datasets, and the Duke-Market1501 instance retrieval task. The results showcase a remarkable improvement margin over existing state-of-the-art techniques. The source code is available https://github.com/freshman97/CSU.


title: Three-pion effects in $K^0-\bar{K}^0$ mixing

abstract: The rate of mixing between a neutral kaon and an anti-kaon ($K^0-\bar{K}^0$) is given, in part, by a long-range matrix element, defined with two insertions of the weak Hamiltonian separated by physical, Minkowski time evolution. For physical quark masses, the kaon mass lies above the two- and three-pion thresholds and, as a result, this long-range matrix element receives contributions from intermediate on-shell $2\pi$ and $3\pi$ states. These contributions cannot easily be captured in a finite Euclidean spacetime, meaning that such matrix elements are not directly accessible via lattice QCD. In this talk, we present a strategy for combining quantities that can be extracted in numerical lattice QCD calculations in order to reproduce the physical, infinite-volume long-range amplitude for $K^0-\bar{K}^0$. The key novelty relative to published work is that we fully include the effects of three-particle states that were previously neglected. The strategy is built on existing formalism for long-range matrix elements with two-particle intermediate states, together with the relativistic-field-theory finite-volume formalism for extracting three-hadron weak decays.


title: Efficient Algorithms for the Bee-Identification Problem

abstract: The bee-identification problem, formally defined by Tandon, Tan and Varshney (2019), requires the receiver to identify "bees" using a set of unordered noisy measurements. In this previous work, Tandon, Tan, and Varshney studied error exponents and showed that decoding the measurements jointly results in a significantly smaller error exponent. In this work, we study algorithms related to this joint decoder. First, we demonstrate how to perform joint decoding efficiently. By reducing to the problem of finding perfect matching and minimum-cost matchings, we obtain joint decoders that run in time quadratic and cubic in the number of "bees" for the binary erasure (BEC) and binary symmetric channels (BSC), respectively. Next, by studying the matching algorithms in the context of channel coding, we further reduce the running times by using classical tools like peeling decoders and list-decoders. In particular, we show that our identifier algorithms when used with Reed-Muller codes terminate in almost linear and quadratic time for BEC and BSC, respectively. Finally, for explicit codebooks, we study when these joint decoders fail to identify the "bees" correctly. Specifically, we provide practical methods of estimating the probability of erroneous identification for given codebooks.


title: Low $p_T$ direct photon production at RHIC measured with PHENIX

abstract: PHENIX has used the versatility of RHIC to map out low $p_{T}$ direct photon production as function of collision system size and beam energy. For systems with a size corresponding to a $dN_{ch}/d\eta$ larger than 20-30, we observe a large yield of direct photons, a large azimuthal anisotropy with respect to the reaction plane, and a characteristic centrality dependence of $dN_{\gamma}/dy \propto (dN_{ch}/d\eta)^{\alpha}$, with $\alpha \sim$ 1.2. \\ In this proceeding, we will present new results from Au+Au collisions at $\sqrt{s_{NN}}$ = 39, 62.4 and 200 GeV. After subtracting the prompt photon component, the inverse slope for the $p_{T}$ range from 1-2 GeV/$c$ is 250 MeV/$c$, but increases to about 400 MeV/$c$ for the range from 2 to 4 GeV/$c$. Within the experimental uncertainty, there is no indication of a system size dependence of the inverse slope. Furthermore, the system size dependence of the yield, expressed through the power $\alpha$, remains independent of $p_{T}$ over the entire observed range from 1 to 6 GeV/$c$. Like the large yield and azimuthal anisotropy, these features, while qualitatively consistent with the emission of thermal photons from the quark gluon plasma, elude a quantitative description through theoretical model calculations.


title: Singularities of Fitzpatrick and convex functions

abstract: In a pseudo-Euclidean space with scalar product $S(\cdot, \cdot)$, we show that the singularities of projections on $S$-monotone sets and of the associated Fitzpatrick functions are covered by countable $c-c$ surfaces having positive normal vectors with respect to the $S$-product. By Zaj\'{\i}\v{c}ek [24], the singularities of a convex function $f$ can be covered by a countable collection of $c-c$ surfaces. We show that the normal vectors to these surfaces are restricted to the cone generated by $F-F$, where $F:=\text{cl range } \nabla f$, the closure of the range of the gradient of $f$.


title: BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics

abstract: The proliferation of automatic faithfulness metrics for summarization has produced a need for benchmarks to evaluate them. While existing benchmarks measure the correlation with human judgements of faithfulness on model-generated summaries, they are insufficient for diagnosing whether metrics are: 1) consistent, i.e., indicate lower faithfulness as errors are introduced into a summary, 2) effective on human-written texts, and 3) sensitive to different error types (as summaries can contain multiple errors). To address these needs, we present a benchmark of unfaithful minimal pairs (BUMP), a dataset of 889 human-written, minimally different summary pairs, where a single error is introduced to a summary from the CNN/DailyMail dataset to produce an unfaithful summary. We find BUMP complements existing benchmarks in a number of ways: 1) the summaries in BUMP are harder to discriminate and less probable under SOTA summarization models, 2) unlike non-pair-based datasets, BUMP can be used to measure the consistency of metrics, and reveals that the most discriminative metrics tend not to be the most consistent, and 3) unlike datasets containing generated summaries with multiple errors, BUMP enables the measurement of metrics' performance on individual error types.


title: A Light Yield Enhancement Method Using Wavelength Shifter for the STCF EMC

abstract: Super Tau-Charm Facility (STCF) is a next-generation high luminosity electron-positron collider facility and is currently one of the major options for accelerator-based particle physics experiment in China. The crystal-based electromagnetic calorimeter (EMC) with undoped CsI is a major sub-system of the STCF spectrometer. To fulfill the increasing physics requirements on measurement precision and the suffering of radiation, improving the detected light yield is an important task of STCF EMC R&D. This paper studies a "wavelength shifting in propagation" scheme for STCF EMC using the nanostructured organosilicon luminophore (NOL). The studies are performed by both Monte Carlo simulation and experimental tests. The light yield is proved to be improved by a factor of 1.59 in the experiment. Meanwhile, a study of the NOL's radiation hardness is carried out to verify the reliability of the NOL. No obvious degradation in the performance is observed with the total ionization does up to 100 krad, far beyond the total radiation dose of STCF with ten years of operation.


title: Beyond Surrogate Modeling: Learning the Local Volatility Via Shape Constraints

abstract: We explore the abilities of two machine learning approaches for no-arbitrage interpolation of European vanilla option prices, which jointly yield the corresponding local volatility surface: a finite dimensional Gaussian process (GP) regression approach under no-arbitrage constraints based on prices, and a neural net (NN) approach with penalization of arbitrages based on implied volatilities. We demonstrate the performance of these approaches relative to the SSVI industry standard. The GP approach is proven arbitrage-free, whereas arbitrages are only penalized under the SSVI and NN approaches. The GP approach obtains the best out-of-sample calibration error and provides uncertainty quantification.The NN approach yields a smoother local volatility and a better backtesting performance, as its training criterion incorporates a local volatility regularization term.


title: Analytic frozen and other low eccentric orbits under J2 perturbation

abstract: This work presents an analytical perturbation method to define and study the dynamics of frozen orbits under the perturbation effects produced by the oblatness of the main celestial body. This is done using a perturbation method purely based on osculating elements. This allows to characterize, define, and study the three existing families of frozen orbits in closed-form: the two families of frozen orbits close to the critical inclination, and the family of frozen orbits that appears at low values of eccentricity. To that end, this work includes the first and second order approximate solutions of the proposed perturbation method, including their applications to define frozen orbits, repeating ground-track orbits, and sun-synchronous orbits. Examples of application are also presented to show the expected error performance of the proposed approach.


title: Half circles on flag manifolds over a semifield

abstract: A flag manifold over a semifield K can be partitioned into "half i-circles" which are orbits of a K-action on that flag manifold. Here i is fixed and it corresponds to a simple reflection in the Weyl group. We prove (for certain K) a connectedness property of the flag manifold: any two points of it can be joined by a finite sequence of half i-circles for various i.


title: Remarks on Fixed Point Assertions in Digital Topology, 6

abstract: This paper continues a series discussing flaws in published assertions concerning fixed points in digital metric spaces.


title: Uncertainty Quantification of MLE for Entity Ranking with Covariates

abstract: This paper concerns with statistical estimation and inference for the ranking problems based on pairwise comparisons with additional covariate information such as the attributes of the compared items. Despite extensive studies, few prior literatures investigate this problem under the more realistic setting where covariate information exists. To tackle this issue, we propose a novel model, Covariate-Assisted Ranking Estimation (CARE) model, that extends the well-known Bradley-Terry-Luce (BTL) model, by incorporating the covariate information. Specifically, instead of assuming every compared item has a fixed latent score $\{\theta_i^*\}_{i=1}^n$, we assume the underlying scores are given by $\{\alpha_i^*+{x}_i^\top\beta^*\}_{i=1}^n$, where $\alpha_i^*$ and ${x}_i^\top\beta^*$ represent latent baseline and covariate score of the $i$-th item, respectively. We impose natural identifiability conditions and derive the $\ell_{\infty}$- and $\ell_2$-optimal rates for the maximum likelihood estimator of $\{\alpha_i^*\}_{i=1}^{n}$ and $\beta^*$ under a sparse comparison graph, using a novel `leave-one-out' technique (Chen et al., 2019) . To conduct statistical inferences, we further derive asymptotic distributions for the MLE of $\{\alpha_i^*\}_{i=1}^n$ and $\beta^*$ with minimal sample complexity. This allows us to answer the question whether some covariates have any explanation power for latent scores and to threshold some sparse parameters to improve the ranking performance. We improve the approximation method used in (Gao et al., 2021) for the BLT model and generalize it to the CARE model. Moreover, we validate our theoretical results through large-scale numerical studies and an application to the mutual fund stock holding dataset.


title: Distributional Robustness Bounds Generalization Errors

abstract: Bayesian methods, distributionally robust optimization methods, and regularization methods are three pillars of trustworthy machine learning combating distributional uncertainty, e.g., the uncertainty of an empirical distribution compared to the true underlying distribution. This paper investigates the connections among the three frameworks and, in particular, explores why these frameworks tend to have smaller generalization errors. Specifically, first, we suggest a quantitative definition for "distributional robustness", propose the concept of "robustness measure", and formalize several philosophical concepts in distributionally robust optimization. Second, we show that Bayesian methods are distributionally robust in the probably approximately correct (PAC) sense; in addition, by constructing a Dirichlet-process-like prior in Bayesian nonparametrics, it can be proven that any regularized empirical risk minimization method is equivalent to a Bayesian method. Third, we show that generalization errors of machine learning models can be characterized using the distributional uncertainty of the nominal distribution and the robustness measures of these machine learning models, which is a new perspective to bound generalization errors, and therefore, explain the reason why distributionally robust machine learning models, Bayesian models, and regularization models tend to have smaller generalization errors in a unified manner.


title: Use of mobile phone sensing data to estimate residence and mobility times in urban patches during the COVID-19 epidemic: The case of the 2020 outbreak in Hermosillo, Mexico

abstract: It is often necessary to introduce the main characteristics of population mobility dynamics to model critical social phenomena such as the economy, violence, transmission of information, or infectious diseases. In this work, we focus on modeling and inferring urban population mobility using the geospatial data of its inhabitants. The objective is to estimate mobility and times inhabitants spend in the areas of interest, such as zip codes and census geographical areas. The proposed method uses the Brownian bridge model for animal movement in ecology. We illustrate its possible applications using mobile phone GPS data in 2020 from the city of Hermosillo, Sonora, in Mexico. We incorporate the estimated residence-mobility matrix into a multi-patch compartmental SEIR model to assess the effect of mobility changes due to governmental interventions


title: Categorical dynamics on stable module categories

abstract: Let $ A $ be a finite connected graded cocommutative Hopf algebra over a field $ k $. There is an endofunctor $ \mathsf{tw} $ on the stable module category $ \mathrm{StMod}_A $ of $ A $ which twists the grading by $ 1 $. We show the categorical entropy of $ \mathsf{tw} $ is zero. We provide a lower bound for the categorical polynomial entropy of $ \mathsf{tw} $ in terms of the Krull dimension of the cohomology of $ A $, and an upper bound in terms of the existence of finite resolutions of $ A $-modules of a particular form. We employ these tools to compute the categorical polynomial entropy of the twist functor for examples of finite graded Hopf algebras over $ \mathbb{F}_2 $.


title: Series acceleration formulas obtained from experimentally discovered hypergeometric recursions

abstract: In 2010, Kh. Hessami Pilehrood and T. Hessami Pilehrood introduced generating function identities used to obtain series accelerations for values of Dirichlet's $\beta$ function, via the Markov--Wilf--Zeilberger method. Inspired by these past results, together with related results introduced by Chu et al., we introduce a variety of hypergeometric recurrences. We prove these recurrences using the WZ method, and we apply these recurrences to obtain series acceleration identities. We introduce a family of summations generalizing a Ramanujan-type series for $\frac{1}{\pi^2}$ due to Guillera, and a family of summations generalizing an accelerated series for Catalan's constant due to Lupa\c{s}, and many related results.


title: Full Conformal Oscillator Representations of Orthogonal Lie Algebras and Combinatorial Identities

abstract: Zhao and the second author (2013) constructed a functor from o(k)-Mod to o(k + 2)-Mod. In this paper, we use the functor successively to obtain an universal first-order differential operator realization for any highest-weight representation of o(2n + 3) in (n + 1)^2 variables and that of o(2n + 2) in n(n + 1) variables. When the highest weight is dominant integral, we determine the corresponding finite-dimensional irreducible module explicitly. One can use the result to study tensor decompositions of finite-dimensional irreducible modules by solving certain first-order linear partial differential equations, and thereby obtain the corresponding physically interested Clebsch-Gordan coefficients and exact solutions of Knizhnik-Zamolodchikov equation in WZW model of conformal field theory. We also find an equation of counting the dimension of an irreducible o(k + 2)-module in terms of certain alternating sum of the dimensions of irreducible o(k)-modules. In the case of the Steinberg modules, we obtain new combinatorial identities of classical type.


title: Learning Subgrid-scale Models with Neural Ordinary Differential Equations

abstract: We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary differential equations (NODEs). Solving systems with fine temporal and spatial grid scales is an ongoing computational challenge, and closure models are generally difficult to tune. Machine learning approaches have increased the accuracy and efficiency of computational fluid dynamics solvers. In this approach neural networks are used to learn the coarse- to fine-grid map, which can be viewed as subgrid-scale parameterization. We propose a strategy that uses the NODE and partial knowledge to learn the source dynamics at a continuous level. Our method inherits the advantages of NODEs and can be used to parameterize subgrid scales, approximate coupling operators, and improve the efficiency of low-order solvers. Numerical results with the two-scale Lorenz 96 ODE, the convection-diffusion PDE, and the viscous Burgers' PDE are used to illustrate this approach.


title: On Improving Summarization Factual Consistency from Natural Language Feedback

abstract: Despite the recent progress in language generation models, their outputs may not always meet user expectations. In this work, we study whether informational feedback in natural language can be leveraged to improve generation quality and user preference alignment. To this end, we consider factual consistency in summarization, the quality that the summary should only contain information supported by the input documents, as the user-expected preference. We collect a high-quality dataset, DeFacto, containing human demonstrations and informational natural language feedback consisting of corrective instructions, edited summaries, and explanations with respect to the factual consistency of the summary. Using our dataset, we study three natural language generation tasks: (1) editing a summary by following the human feedback, (2) generating human feedback for editing the original summary, and (3) revising the initial summary to correct factual errors by generating both the human feedback and edited summary. We show that DeFacto can provide factually consistent human-edited summaries and further insights into summarization factual consistency thanks to its informational natural language feedback. We further demonstrate that fine-tuned language models can leverage our dataset to improve the summary factual consistency, while large language models lack the zero-shot learning ability in our proposed tasks that require controllable text generation.


title: Multiple Testing in Genome-Wide Association Studies via Hierarchical Hidden Markov Models

abstract: The problems of large-scale multiple testing are often encountered in modern scientific researches. Conventional multiple testing procedures usually suffer considerable loss of testing efficiency due to the lack of consideration of correlations among tests. In fact, the appropriate use of correlation information not only enhances the efficacy of multiple testing but also improves the interpretability of the results. Since the disease- or trait-related single nucleotide polymorphisms (SNPs) often tend to be clustered and exhibit serial correlations, the hidden Markov model (HMM) based multiple testing procedure has been successfully applied in genome-wide association studies (GWAS). It is important to note that modeling the entire chromosome using one HMM is somewhat rough. To overcome this issue, this paper employs the hierarchical hidden Markov model (HHMM) to describe local correlations among tests and develops a multiple testing procedure that can not only automatically divide different class of chromosome regions, but also takes into account local correlations among tests. Theoretically, it is shown that the proposed multiple testing procedure is valid and optimal in some sense. Then a data-driven procedure is developed to mimic the oracle version. Extensive simulations and the real data analysis show that the novel multiple testing procedure outperforms its competitors.


title: Data Augmentation on Graphs: A Technical Survey

abstract: In recent years, graph representation learning has achieved remarkable success while suffering from low-quality data problems. As a mature technology to improve data quality in computer vision, data augmentation has also attracted increasing attention in graph domain. To advance research in this emerging direction, this survey provides a comprehensive review and summary of existing graph data augmentation (GDAug) techniques. Specifically, this survey first provides an overview of various feasible taxonomies and categorizes existing GDAug studies based on multi-scale graph elements. Subsequently, for each type of GDAug technique, this survey formalizes standardized technical definition, discuss the technical details, and provide schematic illustration. The survey also reviews domain-specific graph data augmentation techniques, including those for heterogeneous graphs, temporal graphs, spatio-temporal graphs, and hypergraphs. In addition, this survey provides a summary of available evaluation metrics and design guidelines for graph data augmentation. Lastly, it outlines the applications of GDAug at both the data and model levels, discusses open issues in the field, and looks forward to future directions. The latest advances in GDAug are summarized in GitHub.


title: Genus Polynomials of Cubic Graphs with Non-Real Roots

abstract: Given a graph $G$, its genus polynomial is $\Gamma_G(x) = \sum_{k\geq 0} g_k(G)x^k$, where $g_k(G)$ is the number of 2-cell embeddings of $G$ in an orientable surface of genus $k$. The Log-Concavity Genus Distribution (LCGD) Conjecture states that the genus polynomial of every graph is log-concave. It was further conjectured by Stahl that the genus polynomial of every graph has only real roots, however this was later disproved. We identify several examples of cubic graphs whose genus polynomials, in addition to having at least one non-real root, have a quadratic factor that is non-log-concave when factored over the real numbers.


title: Witten-Reshetikhin-Turaev invariants and indefinite false theta functions for plumbing indefinite H-graphs

abstract: Gukov--Pei--Putrov--Vafa conjectured the existence of $ q $-series whose radial limits are Witten--Reshetikhin--Turaev invariants and called them homological blocks. For weakly negative definite plumbed 3-manifolds, Gukov--Pei--Putrov--Vafa and Gukov-Manolescu constructed homological blocks. In this paper, we construct indefinite false theta functions which are candidates of homological blocks for some plumbed $ 3 $-manifolds which are not weakly negative definite. Moreover we prove that, for the Poincar\'{e} homology sphere, our indefinite false theta function coincides with the original homological block.

categories: math.GT hep-th math-ph math.MP math.NT math.QA


title: Handling errors in four-dimensional variational data assimilation by balancing the degrees of freedom and the model constraints: A new approach

abstract: For many years, strongly and weakly constrained approaches were the only options to deal with errors in four-dimensional variational data assimilation (4DVar), with the aim of balancing the degrees of freedom and model constraints. Strong model constraints were imposed to reduce the degrees of freedom encountered when optimizing the strongly constrained 4DVar problem, and it was assumed that the models were perfect. The weakly constrained approach sought to distinguish initial errors from model errors, and to correct them separately using weak model constraints. Our proposed i4DVar* method exploits the hidden mechanism that corrects initial and model errors simultaneously in the strongly constrained 4DVar. The i4DVar* method divides the assimilation window into several sub-windows, each of which has a unique integral and flow-dependent correction term to simultaneously handle the initial and model errors over a relatively short period. To overcome the high degrees of freedom of the weakly constrained 4DVar, for the first time we use ensemble simulations not only to solve the 4DVar optimization problem, but also to formulate this method. Thus, the i4DVar* problem is solvable even if there are many degrees of freedom. We experimentally show that i4DVar* provides superior performance with much lower computational costs than existing methods, and is simple to implement.


title: Insights into undergraduate pathways using course load analytics

abstract: Course load analytics (CLA) inferred from LMS and enrollment features can offer a more accurate representation of course workload to students than credit hours and potentially aid in their course selection decisions. In this study, we produce and evaluate the first machine-learned predictions of student course load ratings and generalize our model to the full 10,000 course catalog of a large public university. We then retrospectively analyze longitudinal differences in the semester load of student course selections throughout their degree. CLA by semester shows that a student's first semester at the university is among their highest load semesters, as opposed to a credit hour-based analysis, which would indicate it is among their lowest. Investigating what role predicted course load may play in program retention, we find that students who maintain a semester load that is low as measured by credit hours but high as measured by CLA are more likely to leave their program of study. This discrepancy in course load is particularly pertinent in STEM and associated with high prerequisite courses. Our findings have implications for academic advising, institutional handling of the freshman experience, and student-facing analytics to help students better plan, anticipate, and prepare for their selected courses.


title: Sophisticated deep learning with on-chip optical diffractive tensor processing

abstract: The ever-growing deep learning technologies are making revolutionary changes for modern life. However, conventional computing architectures are designed to process sequential and digital programs, being extremely burdened with performing massive parallel and adaptive deep learning applications. Photonic integrated circuits provide an efficient approach to mitigate bandwidth limitations and power-wall brought by its electronic counterparts, showing great potential in ultrafast and energy-free high-performance computing. Here, we propose an optical computing architecture enabled by on-chip diffraction to implement convolutional acceleration, termed optical convolution unit (OCU). We demonstrate that any real-valued convolution kernels can be exploited by OCU with a prominent computational throughput boosting via the concept of structral re-parameterization. With OCU as the fundamental unit, we build an optical convolutional neural network (oCNN) to implement two popular deep learning tasks: classification and regression. For classification, Fashion-MNIST and CIFAR-4 datasets are tested with accuracy of 91.63% and 86.25%, respectively. For regression, we build an optical denoising convolutional neural network (oDnCNN) to handle Gaussian noise in gray scale images with noise level {\sigma} = 10, 15, 20, resulting clean images with average PSNR of 31.70dB, 29.39dB and 27.72dB, respectively. The proposed OCU presents remarkable performance of low energy consumption and high information density due to its fully passive nature and compact footprint, providing a highly parallel while lightweight solution for future computing architecture to handle high dimensional tensors in deep learning.


title: Towards Understanding the Impacts of Textual Dissimilarity on Duplicate Bug Report Detection

abstract: About 40% of software bug reports are duplicates of one another, which pose a major overhead during software maintenance. Traditional techniques often focus on detecting duplicate bug reports that are textually similar. However, in bug tracking systems, many duplicate bug reports might not be textually similar, for which the traditional techniques might fall short. In this paper, we conduct a large-scale empirical study to better understand the impacts of textual dissimilarity on the detection of duplicate bug reports. First, we collect a total of 92,854 bug reports from three open-source systems and construct two datasets containing textually similar and textually dissimilar duplicate bug reports. Then we determine the performance of three existing techniques in detecting duplicate bug reports and show that their performance is significantly poor for textually dissimilar duplicate reports. Second, we analyze the two groups of bug reports using a combination of descriptive analysis, word embedding visualization, and manual analysis. We found that textually dissimilar duplicate bug reports often miss important components (e.g., expected behaviors and steps to reproduce), which could lead to their textual differences and poor performance by the existing techniques. Finally, we apply domain-specific embedding to duplicate bug report detection problems, which shows mixed results. All these findings above warrant further investigation and more effective solutions for detecting textually dissimilar duplicate bug reports.


title: Conditioned Generative Transformers for Histopathology Image Synthetic Augmentation

abstract: Deep learning networks have demonstrated state-of-the-art performance on medical image analysis tasks. However, the majority of the works rely heavily on abundantly labeled data, which necessitates extensive involvement of domain experts. Vision transformer (ViT) based generative adversarial networks (GANs) recently demonstrated superior potential in general image synthesis, yet are less explored for histopathology images. In this paper, we address these challenges by proposing a pure ViT-based conditional GAN model for histopathology image synthetic augmentation. To alleviate training instability and improve generation robustness, we first introduce a conditioned class projection method to facilitate class separation. We then implement a multi-loss weighing function to dynamically balance the losses between classification tasks. We further propose a selective augmentation mechanism to actively choose the appropriate generated images and bring additional performance improvements. Extensive experiments on the histopathology datasets show that leveraging our synthetic augmentation framework results in significant and consistent improvements in classification performance.


title: Coarse-grained modeling of polymers with end-on and side-on liquid crystal moieties: effect of architecture

abstract: Mesogens, which are typically stiff rodlike or disklike molecules, are able to self-organize into liquid crystal (LC) phases in a certain temperature range. Such mesogens, or LC groups, can be attached to polymer chains in various configurations including within the backbone (main-chain LC polymers) or at the ends of side-chains attached to the backbone in an end-on or side-on configuration (side-chain LC polymers or SCLCPs), which can display synergistic properties arising from both their LC and polymeric character. At lower temperatures, chain conformations may be significantly altered due to the mesoscale LC ordering, thus, when heating from the LC ordered state through the LC to isotropic phase transition, the chains return from a more stretched to a more random coil conformation. This can cause macroscopic shape changes, which depend significantly on the type of LC attachment and other architectural properties of the polymer. Here, to study the structure-property relationships for SCLCPs with a range of different architectures, we develop a coarse-grained model that includes torsional potentials along with LC interactions of a Gay--Berne form. We create systems of different side chain lengths, chain stiffnesses, and LC attachment types, and track their structural properties as a function of temperature. Our modeled systems indeed form a variety of well-organized mesophase structures at low temperatures, and we predict higher LC to isotropic transition temperatures for the end-on side-chain systems than for analogous side-on side-chain systems. Understanding these phase transitions and their dependence on polymer architecture can be useful in designing materials with reversible and controllable deformations.


title: Flareon: Stealthy any2any Backdoor Injection via Poisoned Augmentation

abstract: Open software supply chain attacks, once successful, can exact heavy costs in mission-critical applications. As open-source ecosystems for deep learning flourish and become increasingly universal, they present attackers previously unexplored avenues to code-inject malicious backdoors in deep neural network models. This paper proposes Flareon, a small, stealthy, seemingly harmless code modification that specifically targets the data augmentation pipeline with motion-based triggers. Flareon neither alters ground-truth labels, nor modifies the training loss objective, nor does it assume prior knowledge of the victim model architecture, training data, and training hyperparameters. Yet, it has a surprisingly large ramification on training -- models trained under Flareon learn powerful target-conditional (or "any2any") backdoors. The resulting models can exhibit high attack success rates for any target choices and better clean accuracies than backdoor attacks that not only seize greater control, but also assume more restrictive attack capabilities. We also demonstrate the effectiveness of Flareon against recent defenses. Flareon is fully open-source and available online to the deep learning community: https://github.com/lafeat/flareon.


title: Continual Mean Estimation Under User-Level Privacy

abstract: We consider the problem of continually releasing an estimate of the population mean of a stream of samples that is user-level differentially private (DP). At each time instant, a user contributes a sample, and the users can arrive in arbitrary order. Until now these requirements of continual release and user-level privacy were considered in isolation. But, in practice, both these requirements come together as the users often contribute data repeatedly and multiple queries are made. We provide an algorithm that outputs a mean estimate at every time instant $t$ such that the overall release is user-level $\varepsilon$-DP and has the following error guarantee: Denoting by $M_t$ the maximum number of samples contributed by a user, as long as $\tilde{\Omega}(1/\varepsilon)$ users have $M_t/2$ samples each, the error at time $t$ is $\tilde{O}(1/\sqrt{t}+\sqrt{M}_t/t\varepsilon)$. This is a universal error guarantee which is valid for all arrival patterns of the users. Furthermore, it (almost) matches the existing lower bounds for the single-release setting at all time instants when users have contributed equal number of samples.


title: Benchmarking person re-identification datasets and approaches for practical real-world implementations

abstract: Recently, Person Re-Identification (Re-ID) has received a lot of attention. Large datasets containing labeled images of various individuals have been released, allowing researchers to develop and test many successful approaches. However, when such Re-ID models are deployed in new cities or environments, the task of searching for people within a network of security cameras is likely to face an important domain shift, thus resulting in decreased performance. Indeed, while most public datasets were collected in a limited geographic area, images from a new city present different features (e.g., people's ethnicity and clothing style, weather, architecture, etc.). In addition, the whole frames of the video streams must be converted into cropped images of people using pedestrian detection models, which behave differently from the human annotators who created the dataset used for training. To better understand the extent of this issue, this paper introduces a complete methodology to evaluate Re-ID approaches and training datasets with respect to their suitability for unsupervised deployment for live operations. This method is used to benchmark four Re-ID approaches on three datasets, providing insight and guidelines that can help to design better Re-ID pipelines in the future.


title: Joint Speech Transcription and Translation: Pseudo-Labeling with Out-of-Distribution Data

abstract: Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool. In this work, we investigate and use pseudo-labeling for a recently proposed novel setup: joint transcription and translation of speech, which suffers from an absence of sufficient data resources. We show that under such data-deficient circumstances, the unlabeled data can significantly vary in domain from the supervised data, which results in pseudo-label quality degradation. We investigate two categories of remedies that require no additional supervision and target the domain mismatch: pseudo-label filtering and data augmentation. We show that pseudo-label analysis and processing as such results in additional gains on top of the vanilla pseudo-labeling setup resulting in total improvements of up to 0.6% absolute WER and 2.2 BLEU points.


title: Texture Representation via Analysis and Synthesis with Generative Adversarial Networks

abstract: We investigate data-driven texture modeling via analysis and synthesis with generative adversarial networks. For network training and testing, we have compiled a diverse set of spatially homogeneous textures, ranging from stochastic to regular. We adopt StyleGAN3 for synthesis and demonstrate that it produces diverse textures beyond those represented in the training data. For texture analysis, we propose GAN inversion using a novel latent domain reconstruction consistency criterion for synthesized textures, and iterative refinement with Gramian loss for real textures. We propose perceptual procedures for evaluating network capabilities, exploring the global and local behavior of latent space trajectories, and comparing with existing texture analysis-synthesis techniques.


title: Using Machine Learning to Determine Morphologies of $z<1$ AGN Host Galaxies in the Hyper Suprime-Cam Wide Survey

abstract: We present a machine-learning framework to accurately characterize morphologies of Active Galactic Nucleus (AGN) host galaxies within $z<1$. We first use PSFGAN to decouple host galaxy light from the central point source, then we invoke the Galaxy Morphology Network (GaMorNet) to estimate whether the host galaxy is disk-dominated, bulge-dominated, or indeterminate. Using optical images from five bands of the HSC Wide Survey, we build models independently in three redshift bins: low $(0<z<0.25)$, medium $(0.25<z<0.5)$, and high $(0.5<z<1.0)$. By first training on a large number of simulated galaxies, then fine-tuning using far fewer classified real galaxies, our framework predicts the actual morphology for $\sim$ $60\%-70\%$ host galaxies from test sets, with a classification precision of $\sim$ $80\%-95\%$, depending on redshift bin. Specifically, our models achieve disk precision of $96\%/82\%/79\%$ and bulge precision of $90\%/90\%/80\%$ (for the 3 redshift bins), at thresholds corresponding to indeterminate fractions of $30\%/43\%/42\%$. The classification precision of our models has a noticeable dependency on host galaxy radius and magnitude. No strong dependency is observed on contrast ratio. Comparing classifications of real AGNs, our models agree well with traditional 2D fitting with GALFIT. The PSFGAN+GaMorNet framework does not depend on the choice of fitting functions or galaxy-related input parameters, runs orders of magnitude faster than GALFIT, and is easily generalizable via transfer learning, making it an ideal tool for studying AGN host galaxy morphology in forthcoming large imaging survey.


title: The Stable Picard Group of A(n)

abstract: In this paper, we showed that the Stable Picard group of $A(n)$ for $n\geq 2$ is $\mathbb{Z}\oplus \mathbb{Z}$ by considering the endotrivial modules over $A(n)$. The proof relies on reductions from a Hopf algebra to its proper Hopf subalgebras.


title: The Effects of Connectivity and Automation on Saturation Headway and Capacity at Signalized Intersections

abstract: This paper analyzes the potential effects of connected and automated vehicles on saturation headway and capacity at signalized intersections. A signalized intersection is created in Vissim as a testbed, where four vehicle types are modeled and tested: (I) human-driven vehicles (HVs), (II) connected vehicles (CVs), (III) automated vehicles (AVs), and (IV) connected automated vehicles (CAVs). Various scenarios are defined based on different market penetration rates of these four vehicle types. AVs are assumed to move more cautiously compared to human drivers. CVs and CAVs are supposed to receive information about the future state of traffic lights and adjust their speeds to avoid stopping at the intersection. As a result, their movements are expected to be smoother with a lower number of stops. The effects of these vehicle types in mixed traffic are investigated in terms of saturation headway, capacity, travel time, delay, and queue length in different lane groups of an intersection. A Python script code developed by Vissim is used to provide the communication between the signal controller and CVs and CAVs to adjust their speeds accordingly. The results show that increasing CV and CAV market penetration rate reduces saturation headway and consequently increases capacity at signalized intersections. On the other hand, increasing the AV market penetration rate deteriorates traffic operations. Results also indicate that the highest increase (80%) and decrease (20%) in lane group capacity are observed, respectively, in a traffic stream of 100% CAVs and 100% AVs.


title: Uncertainty Error Modeling for Non-Linear State Estimation With Unsynchronized SCADA and $\mu$PMU Measurements

abstract: Distribution systems of the future smart grid require enhancements to the reliability of distribution system state estimation (DSSE) in the face of low measurement redundancy, unsynchronized measurements, and dynamic load profiles. Micro phasor measurement units ($\mu$PMUs) facilitate co-synchronized measurements with high granularity, albeit at an often prohibitively expensive installation cost. Supervisory control and data acquisition (SCADA) measurements can supplement $\mu$PMU data, although they are received at a slower sampling rate. Further complicating matters is the uncertainty associated with load dynamics and unsynchronized measurements-not only are the SCADA and $\mu$PMU measurements not synchronized with each other, but the SCADA measurements themselves are received at different time intervals with respect to one another. This paper proposes a non-linear state estimation framework which models dynamic load uncertainty error by updating the variances of the unsynchronized measurements, leading to a time-varying system of weights in the weighted least squares state estimator. Case studies are performed on the 33-Bus Distribution System in MATPOWER, using Ornstein-Uhlenbeck stochastic processes to simulate dynamic load conditions.


title: Multi-Reference Image Super-Resolution: A Posterior Fusion Approach

abstract: Reference-based Super-resolution (RefSR) approaches have recently been proposed to overcome the ill-posed problem of image super-resolution by providing additional information from a high-resolution image. Multi-reference super-resolution extends this approach by allowing more information to be incorporated. This paper proposes a 2-step-weighting posterior fusion approach to combine the outputs of RefSR models with multiple references. Extensive experiments on the CUFED5 dataset demonstrate that the proposed methods can be applied to various state-of-the-art RefSR models to get a consistent improvement in image quality.


title: High Impedance Fault Detection Through Quasi-Static State Estimation: A Parameter Error Modeling Approach

abstract: This paper presents a model for detecting high-impedance faults (HIFs) using parameter error modeling and a two-step per-phase weighted least squares state estimation (SE) process. The proposed scheme leverages the use of phasor measurement units and synthetic measurements to identify per-phase power flow and injection measurements which indicate a parameter error through $\chi^2$ Hypothesis Testing applied to the composed measurement error (CME). Although current and voltage waveforms are commonly analyzed for high-impedance fault detection, wide-area power flow and injection measurements, which are already inherent to the SE process, also show promise for real-world high-impedance fault detection applications. The error distributions after detection share the measurement function error spread observed in proven parameter error diagnostics and can be applied to HIF identification. Further, this error spread related to the HIF will be clearly discerned from measurement error. Case studies are performed on the 33-Bus Distribution System in Simulink.


title: Distributed Software-Defined Network Architecture for Smart Grid Resilience to Denial-of-Service Attacks

abstract: An important challenge for smart grid security is designing a secure and robust smart grid communications architecture to protect against cyber-threats, such as Denial-of-Service (DoS) attacks, that can adversely impact the operation of the power grid. Researchers have proposed using Software Defined Network frameworks to enhance cybersecurity of the smart grid, but there is a lack of benchmarking and comparative analyses among the many techniques. In this work, a distributed three-controller software-defined networking (D3-SDN) architecture, benchmarking and comparative analysis with other techniques is presented. The selected distributed flat SDN architecture divides the network horizontally into multiple areas or clusters, where each cluster is handled by a single Open Network Operating System (ONOS) controller. A case study using the IEEE 118-bus system is provided to compare the performance of the presented ONOS-managed D3-SDN, against the POX controller. In addition, the proposed architecture outperforms a single SDN controller framework by a tenfold increase in throughput; a reduction in latency of $>20\%$; and an increase in throughput of approximately $11\%$ during the DoS attack scenarios.


title: Dynamic Molecular Graph-based Implementation for Biophysical Properties Prediction

abstract: Neural Networks (GNNs) have revolutionized the molecular discovery to understand patterns and identify unknown features that can aid in predicting biophysical properties and protein-ligand interactions. However, current models typically rely on 2-dimensional molecular representations as input, and while utilization of 2\3- dimensional structural data has gained deserved traction in recent years as many of these models are still limited to static graph representations. We propose a novel approach based on the transformer model utilizing GNNs for characterizing dynamic features of protein-ligand interactions. Our message passing transformer pre-trains on a set of molecular dynamic data based off of physics-based simulations to learn coordinate construction and make binding probability and affinity predictions as a downstream task. Through extensive testing we compare our results with the existing models, our MDA-PLI model was able to outperform the molecular interaction prediction models with an RMSE of 1.2958. The geometric encodings enabled by our transformer architecture and the addition of time series data add a new dimensionality to this form of research.