title: A reanalysis of the latest SH0ES data for $H_0$: Effects of new degrees of freedom on the Hubble tension

abstract: We reanalyze the recently released SH0ES data for the determination of $H_0$. We focus on testing the homogeneity of the Cepheid+SnIa sample and the robustness of the results in the presence of new degrees of freedom in the modeling of Cepheids and SnIa. We thus focus on the four modeling parameters of the analysis: the fiducial luminosity of SnIa $M_B$ and Cepheids $M_W$ and the two parameters ($b_W$ and $Z_W$) standardizing Cepheid luminosities with period and metallicity. After reproducing the SH0ES baseline model results, we allow for a transition of the value of any one of these parameters at a given distance $D_c$ or cosmic time $t_c$ thus adding a single degree of freedom in the analysis. When the SnIa absolute magnitude $M_B$ is allowed to have a transition at $D_c\simeq 50Mpc$ (about $160Myrs$ ago), the best fit value of the Hubble parameter drops from $H_{0}=73.04\pm1.04\,km\,s^{-1}\,Mpc^{-1}$ to $H_0=67.32\pm 4.64\, km\,s^{-1}\,Mpc^{-1}$ in full consistency with the Planck value. Also, the best fit SnIa absolute magnitude $M_B^>$ for $D>D_c$ drops to the Planck inverse distance ladder value $M_{B}^>=-19.43\pm 0.15$ while the low distance best fit $M_B^<$ parameter remains close to the original distance ladder calibrated value $M_{B}^<=-19.25\pm 0.03$. Similar hints for a transition behavior is found for the other three main parameters of the analysis ($b_W$, $M_W$ and $Z_W$) at the same critical distance $D_c\simeq 50\,Mpc$ even though in that case the best fit value of $H_0$ is not significantly affected. When the inverse distance ladder constraint on $M_B^>$ is included in the analysis, the uncertainties for $H_0$ reduce dramatically ($H_0= 68.2\pm 0.8\, km\,s^{-1}\,Mpc^{-1}$) and the $M_B$ transition model is strongly preferred over the baseline SH0ES model ($\Delta \chi^2 \simeq -15$, $\Delta AIC \simeq -13$) according to AIC and BIC model selection criteria.


title: "It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Reality

abstract: In social Virtual Reality (VR), users are embodied in avatars and interact with other users in a face-to-face manner using avatars as the medium. With the advent of social VR, people with disabilities (PWD) have shown an increasing presence on this new social media. With their unique disability identity, it is not clear how PWD perceive their avatars and whether and how they prefer to disclose their disability when presenting themselves in social VR. We fill this gap by exploring PWD's avatar perception and disability disclosure preferences in social VR. Our study involved two steps. We first conducted a systematic review of fifteen popular social VR applications to evaluate their avatar diversity and accessibility support. We then conducted an in-depth interview study with 19 participants who had different disabilities to understand their avatar experiences. Our research revealed a number of disability disclosure preferences and strategies adopted by PWD (e.g., reflect selective disabilities, present a capable self). We also identified several challenges faced by PWD during their avatar customization process. We discuss the design implications to promote avatar accessibility and diversity for future social VR platforms.


title: Conceptual Modeling of Aggregation: an Exploration

abstract: This paper is about conceptual modeling of aggregates in software engineering. An aggregate is a cluster of domain objects that can be treated as a single unit. In UML, an aggregation is a type of association in which objects are configured together to form a more complex object. It has been described as one of the biggest betes noires in modeling. In spite of its widespread use, aggregation seems a troublesome concept. It is sometimes treated as part-of; however, the part-of relation is only one of many possible aggregation mechanisms and is itself problematical, partly because of its diverse semantics. The purpose of this paper is to develop a semantic assembly model that is useful to represent relationships in the domain and achieve various levels of interoperability among software. The paper contributes to ontological conceptual clarity about aggregation, based on a model called a thinging machine (TM). The TM model uses so-called thimacs (things/machines) as building blocks for describing the domain. Thus, the notion of aggregation is extended to behavioral aggregation, in which individual entities collectively behave as a unit. The results point to a promising contribution to the understanding of the notion of aggregation compared to the ontological positions that are based on substance or relation.


title: Dilation two embedding one-by-one particular sub-quadtree into M-dimentional crossed cubes

abstract: In the parallel processing field, graph embedding is motivated by simulation interconnection networks to another. The quadtree is an important technique used to present spatial data and is used in many application domains, especially computer vision and image processing. Researchers are interested in the construction and manipulation of quadtrees on parallel machines. The crossed cubes consider an alternative to the ordinary hypercube. It offers many attractive properties. Significantly, it reduces diameter by a factor of 2 that of the ordinary cubes. Moreover, the crossed cubes have a great capacity to simulate other architectures. This paper is interested in the one-by-one dilation two embedding of a particular sub-quadtree graph into m-dimensional crossed cubes.


title: The Alberta Plan for AI Research

abstract: Herein we describe our approach to artificial intelligence research, which we call the Alberta Plan. The Alberta Plan is pursued within our research groups in Alberta and by others who are like minded throughout the world. We welcome all who would join us in this pursuit.


title: Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

abstract: Graphics processing units (GPUs) are now considered the leading hardware to accelerate general-purpose workloads such as AI, data analytics, and HPC. Over the last decade, researchers have focused on demystifying and evaluating the microarchitecture features of various GPU architectures beyond what vendors reveal. This line of work is necessary to understand the hardware better and build more efficient workloads and applications. Many works have studied the recent Nvidia architectures, such as Volta and Turing, comparing them to their successor, Ampere. However, some microarchitecture features, such as the clock cycles for the different instructions, have not been extensively studied for the Ampere architecture. In this paper, we study the clock cycles per instructions with various data types found in the instruction-set architecture (ISA) of Nvidia GPUs. Using microbenchmarks, we measure the clock cycles for PTX ISA instructions and their SASS ISA instructions counterpart. we further calculate the clock cycle needed to access each memory unit. We also demystify the new version of the tensor core unit found in the Ampere architecture by using the WMMA API and measuring its clock cycles per instruction and throughput for the different data types and input shapes. The results found in this work should guide software developers and hardware architects. Furthermore, the clock cycles per instructions are widely used by performance modeling simulators and tools to model and predict the performance of the hardware.


title: Ordinal analysis of lexical patterns

abstract: Words are fundamental linguistic units that connect thoughts and things through meaning. However, words do not appear independently in a text sequence. The existence of syntactic rules induces correlations among neighboring words. Using an ordinal pattern approach, we present an analysis of lexical statistical connections for 11 major languages. We find that the diverse manners that languages utilize to express word relations give rise to unique pattern structural distributions. Furthermore, fluctuations of these pattern distributions for a given language can allow us to determine both the historical period when the text was written and its author. Taken together, our results emphasize the relevance of ordinal time series analysis in linguistic typology, historical linguistics and stylometry.


title: A Study on the Impact of Data Augmentation for Training Convolutional Neural Networks in the Presence of Noisy Labels

abstract: Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that evaluate the impact of data augmentation as a design choice for training deep neural networks. In this work, we analyse the model robustness when using different data augmentations and their improvement on the training with the presence of noisy labels. We evaluate state-of-the-art and classical data augmentation strategies with different levels of synthetic noise for the datasets MNist, CIFAR-10, CIFAR-100, and the real-world dataset Clothing1M. We evaluate the methods using the accuracy metric. Results show that the appropriate selection of data augmentation can drastically improve the model robustness to label noise, increasing up to 177.84% of relative best test accuracy compared to the baseline with no augmentation, and an increase of up to 6% in absolute value with the state-of-the-art DivideMix training strategy.


title: Phase Separation in Wetting Ridges of Sliding Drops on Soft and Swollen Surfaces

abstract: Drops in contact with swollen, elastomeric substrates can induce a capillary-mediated phase separation in wetting ridges. Using laser scanning confocal microscopy, we visualize phase separation of oligomeric silicone oil from a crosslinked silicone network during steady-state sliding of water drops. We find an inverse relationship between the oil tip height and the drop sliding speed, which is rationalized by competing transport timescales of oil molecules: separation rate and drop-advection speed. Separation rates in highly swollen networks are as fast as diffusion in pure melts.


title: An Experimental Investigation of Tuning QUIC-Based Publish-Subscribe Architectures in IoT

abstract: There has been growing interest in using the QUIC transport protocol for the Internet of Things (IoT). In lossy and high latency networks, QUIC outperforms TCP and TLS. Since IoT greatly differs from traditional networks in terms of architecture and resources, IoT specific parameter tuning has proven to be of significance. While RFC 9006 offers a guideline for tuning TCP within IoT, we have not found an equivalent for QUIC. This paper is the first of our knowledge to contribute empirically based insights towards tuning QUIC for IoT. We improved our pure HTTP/3 publish-subscribe architecture and rigorously benchmarked it against an alternative: MQTT-over-QUIC. To investigate the impact of transport-layer parameters, we ran both applications on Raspberry Pi Zero hardware. Eight metrics were collected while emulating different network conditions and message payloads. We enumerate the points we experimentally identified (notably, relating to authentication, MAX\_STREAM messages, and timers) and elaborate on how they can be tuned to improve resource consumption and performance. Our application offered lower latency than MQTT-over-QUIC with slightly higher resource consumption, making it preferable for reliable time-sensitive dissemination of information.


title: Celestial chiral algebras, colour-kinematics duality and integrability

abstract: We study celestial chiral algebras appearing in celestial holography, using the light-cone gauge formulation of self-dual Yang-Mills theory and self-dual gravity, and explore also a deformation of the latter. The recently discussed $w_{1+\infty}$ algebra in self-dual gravity arises from the soft expansion of an area-preserving diffeomorphism algebra, which plays the role of the kinematic algebra in the colour-kinematics duality and the double copy relation between the self-dual theories. The $W_{1+\infty}$ deformation of $w_{1+\infty}$ arises from a Moyal deformation of self-dual gravity. This theory is interpreted as a constrained chiral higher-spin gravity, where the field is a tower of higher-spin components fully constrained by the graviton component. In all these theories, the chiral structure of the operator-product expansion exhibits the colour-kinematics duality: the implicit `left algebra' is the self-dual kinematic algebra, while the `right algebra' provides the structure constants of the operator-product expansion, ensuring its associativity at tree level. In a scattering amplitudes version of the Ward conjecture, the left algebra ensures the classical integrability of this type of theories. In particular, it enforces the vanishing of the tree-level amplitudes via the double copy.


title: Auditing Membership Leakages of Multi-Exit Networks

abstract: Relying on the fact that not all inputs require the same amount of computation to yield a confident prediction, multi-exit networks are gaining attention as a prominent approach for pushing the limits of efficient deployment. Multi-exit networks endow a backbone model with early exits, allowing to obtain predictions at intermediate layers of the model and thus save computation time and/or energy. However, current various designs of multi-exit networks are only considered to achieve the best trade-off between resource usage efficiency and prediction accuracy, the privacy risks stemming from them have never been explored. This prompts the need for a comprehensive investigation of privacy risks in multi-exit networks. In this paper, we perform the first privacy analysis of multi-exit networks through the lens of membership leakages. In particular, we first leverage the existing attack methodologies to quantify the multi-exit networks' vulnerability to membership leakages. Our experimental results show that multi-exit networks are less vulnerable to membership leakages and the exit (number and depth) attached to the backbone model is highly correlated with the attack performance. Furthermore, we propose a hybrid attack that exploits the exit information to improve the performance of existing attacks. We evaluate membership leakage threat caused by our hybrid attack under three different adversarial setups, ultimately arriving at a model-free and data-free adversary. These results clearly demonstrate that our hybrid attacks are very broadly applicable, thereby the corresponding risks are much more severe than shown by existing membership inference attacks. We further present a defense mechanism called TimeGuard specifically for multi-exit networks and show that TimeGuard mitigates the newly proposed attacks perfectly.


title: Ramsey numbers upon vertex deletion

abstract: Given a graph $G$, its Ramsey number $r(G)$ is the minimum $N$ so that every two-coloring of $E(K_N)$ contains a monochromatic copy of $G$. It was conjectured by Conlon, Fox, and Sudakov that if one deletes a single vertex from $G$, the Ramsey number can change by at most a constant factor. We disprove this conjecture, exhibiting an infinite family of graphs such that deleting a single vertex from each decreases the Ramsey number by a super-constant factor. One consequence of this result is the following. There exists a family of graphs $\{G_n\}$ so that in any Ramsey coloring for $G_n$ (that is, a coloring of a clique on $r(G_n)-1$ vertices with no monochromatic copy of $G_n$), one of the color classes has density $o(1)$.


title: Identification of a potential ultra-low Q value electron capture decay branch in $^{75}$Se via a precise Penning trap measurement of the mass of $^{75}$As

abstract: Background: Low energy $\beta$ and electron capture (EC) decays are important systems in neutrino mass determination experiments. An isotope with an ultra-low Q value $\beta$-decay to an excited state in the daughter with Qes < 1 keV could provide a promising alternative candidate for future experiments. $^{75}$Se EC and $^{75}$Ge $\beta$-decay represent such candidates, but a more precise determination of the mass of the common daughter, $^{75}$As, is required to evaluate whether their potential decay branches are energetically allowed and ultra-low. Purpose: Perform a precise atomic mass measurement of $^{75}$As and combine the result with the precisely known atomic masses of $^{75}$Se and $^{75}$Ge, along with nuclear energy level data for $^{75}$As to evaluate potential ultra-low Q value decay branches in the EC decay of $^{75}$Se and the $\beta$-decay of $^{75}$Ge. Method: The LEBIT Penning trap mass spectrometer at the Facility for Rare Isotope Beams was used to perform a high-precision measurement of the atomic mass of $^{75}$As via cyclotron frequency ratio measurements of $^{75}$As$^{+}$ to a $^{12}$C$_{6}^{+}$ reference ion. Results: The $^{75}$As mass excess was determined to be ME($^{75}$As)= -73 035.98(43) keV, from which the ground-state to ground-state Q values for $^{75}$Se EC and $^{75}$Ge $\beta$-decay were determined to be 866.50(44) keV and 1179.01(44) keV, respectively. These results were compared to energies of excited states in $^{75}$As at 865.4(5) keV and 1172.0(6) keV to determine Q values of 1.1(7) keV and 7.0(7) keV for the potential ultra-low EC and $\beta$-decay branches of $^{75}$Se and $^{75}$Ge, respectively. Conclusion: The $^{75}$Se EC decay to the 865.4 keV excited state in $^{75}$As is potentially ultra-low with Qes $\approx$ 1 keV. However, a more precise determination of the 865.4(5) keV level in $^{75}$As is required.


title: Derived equivalences of generalized Kummer varieties

abstract: In this article we study derived (auto)equivalences of generalized Kummer varieties $\mathrm{Kum}^n(A)$. We provide an answer to a question raised by Namikawa by showing that the generalized Kummer varieties $\mathrm{Kum}^n(A)$ and $\mathrm{Kum}^n(A^\vee)$ are derived equivalent as long as $n$ is even and the abelian surface $A$ admits a polarization whose exponent is coprime to $n+1$. Furthermore we obtain exact sequences involving groups of autoequivalences in the style of Orlov's short exact sequence for autoequivalences of abelian varieties.


title: AIM 2022 Challenge on Super-Resolution of Compressed Image and Video: Dataset, Methods and Results

abstract: This paper reviews the Challenge on Super-Resolution of Compressed Image and Video at AIM 2022. This challenge includes two tracks. Track 1 aims at the super-resolution of compressed image, and Track~2 targets the super-resolution of compressed video. In Track 1, we use the popular dataset DIV2K as the training, validation and test sets. In Track 2, we propose the LDV 3.0 dataset, which contains 365 videos, including the LDV 2.0 dataset (335 videos) and 30 additional videos. In this challenge, there are 12 teams and 2 teams that submitted the final results to Track 1 and Track 2, respectively. The proposed methods and solutions gauge the state-of-the-art of super-resolution on compressed image and video. The proposed LDV 3.0 dataset is available at https://github.com/RenYang-home/LDV_dataset. The homepage of this challenge is at https://github.com/RenYang-home/AIM22_CompressSR.


title: Asset Participation and Aggregation in Incentive-Based Demand Response Programs

abstract: In order to manage peak-grid events, utilities run incentive-based demand response (DR) programs in which they offer an incentive to assets who promise to curtail power consumption, and impose penalties if they fail to do so. We develop a probabilistic model for the curtailment capability of these assets, and use it to derive analytic expressions for the optimal participation (i.e., promised curtailment) and profitability from the DR asset perspective. We also investigate the effects of risk-aversion and curtailment uncertainty on both promised curtailment and profit. We use the probabilistic model to evaluate the benefits of forming asset aggregations for participation in DR programs, and develop a numerical test to estimate asset complementarity. We illustrate our results using load data from commercial office buildings.


title: The amplification of cosmological magnetic fields in Extended $f(T,B)$ Teleparallel Gravity

abstract: Observations indicate that intergalactic magnetic fields have amplitudes of the order of $\sim 10^{-6}$ G and are uniform on scales of $\sim 10$ kpc. Despite their wide presence in the Universe, their origin remains an open issue. Even by invoking a dynamo mechanism or a compression effect for magnetic field amplification, the existence of seed fields before galaxy formation is still problematic. General Relativity predicts an adiabatic decrease of the magnetic field evolving as $|\mathbf{B}|\propto 1/a^{2}$, where $a$ is the scale factor of the Universe. It results in very small primordial fields, unless the conformal symmetry of the electromagnetic sector is broken. In this paper, we study the possibility that a natural mechanism for the amplification of primordial magnetic field can be related to extended teleparallel gravity $f(T, B)$ models, where $T$ is the torsion scalar, and $B$ the boundary term. In particular, we consider a non-minimal coupling with gravity in view to break conformal symmetry in a teleparallel background, investigating, in particular, the role of boundary term $B$, which can be consider as a further scalar field. We find that, after solving exactly the $f(T,B)$ field equations both in inflation and reheating eras, a non-adiabatic behavior of the magnetic field is always possible, and a strong amplification appears in the reheating epoch. We also compute the ratio $r=\rho_{B}/ \rho_{\gamma}$ between the magnetic energy density and the cosmic microwave energy density during inflation, in order to explain the present value $r\simeq 1$, showing that, in the slow-roll approximation, power-law teleparallel theories with $B^{n}$ have effects indistinguishable from metric theories $R^{n}$ where $R$ is the Ricci curvature scalar..


title: Achieving Fairness in Dermatological Disease Diagnosis through Automatic Weight Adjusting Federated Learning and Personalization

abstract: Dermatological diseases pose a major threat to the global health, affecting almost one-third of the world's population. Various studies have demonstrated that early diagnosis and intervention are often critical to prognosis and outcome. To this end, the past decade has witnessed the rapid evolvement of deep learning based smartphone apps, which allow users to conveniently and timely identify issues that have emerged around their skins. In order to collect sufficient data needed by deep learning and at the same time protect patient privacy, federated learning is often used, where individual clients aggregate a global model while keeping datasets local. However, existing federated learning frameworks are mostly designed to optimize the overall performance, while common dermatological datasets are heavily imbalanced. When applying federated learning to such datasets, significant disparities in diagnosis accuracy may occur. To address such a fairness issue, this paper proposes a fairness-aware federated learning framework for dermatological disease diagnosis. The framework is divided into two stages: In the first in-FL stage, clients with different skin types are trained in a federated learning process to construct a global model for all skin types. An automatic weight aggregator is used in this process to assign higher weights to the client with higher loss, and the intensity of the aggregator is determined by the level of difference between losses. In the latter post-FL stage, each client fine-tune its personalized model based on the global model in the in-FL stage. To achieve better fairness, models from different epochs are selected for each client to keep the accuracy difference of different skin types within 0.05. Experiments indicate that our proposed framework effectively improves both fairness and accuracy compared with the state-of-the-art.


title: On Fitness Landscape Analysis of Permutation Problems: From Distance Metrics to Mutation Operator Selection

abstract: In this paper, we explore the theory and expand upon the practice of fitness landscape analysis for optimization problems over the space of permutations. Many of the computational and analytical tools for fitness landscape analysis, such as fitness distance correlation, require identifying a distance metric for measuring the similarity of different solutions to the problem. We begin with a survey of the available distance metrics for permutations, and then use principal component analysis to classify these metrics. The result of this analysis aligns with existing classifications of permutation problem types produced through less formal means, including the A-permutation, R-permutation, and P-permutation types, which classifies problems by whether absolute position of permutation elements, relative positions of elements, or general precedence of pairs of elements, is the dominant influence over solution fitness. Additionally, the formal analysis identifies subtypes within these problem categories. We see that the classification can assist in identifying appropriate metrics based on optimization problem feature for use in fitness landscape analysis. Using optimization problems of each class, we also demonstrate how the classification scheme can subsequently inform the choice of mutation operator within an evolutionary algorithm. From this, we present a classification of a variety of mutation operators as a counterpart to that of the metrics. Our implementations of the permutation metrics, permutation mutation operators, and associated evolutionary algorithm, are available in a pair of open source Java libraries. All of the code necessary to recreate our analysis and experimental results are also available as open source.


title: Contrarian Voter Model under the influence of an Oscillating Propaganda: Consensus, Bimodal behavior and Stochastic Resonance

abstract: We study the contrarian voter model for opinion formation in a society under the influence of an external oscillating propaganda and stochastic noise. Each agent of the population can hold one of two possible opinions on a given issue --against or in favor, and interacts with its neighbors following either an imitation dynamics (voter behavior) or an anti-alignment dynamics (contrarian behavior): each agent adopts the opinion of a random neighbor with a time-dependent probability $p(t)$, or takes the opposite opinion with probability $1-p(t)$. The imitation probability $p(t)$ is controlled by the social temperature $T$, and varies in time according to a periodic field that mimics the influence of an external propaganda, so that a voter is more prone to adopt an opinion aligned with the field. We simulate the model in complete graph and in lattices, and find that the system exhibits a rich variety of behaviors as $T$ is varied: opinion consensus for $T=0$, a bimodal behavior for $T<T_c$, an oscillatory behavior where the mean opinion oscillates in time with the field for $T>T_c$, and full disorder for $T \gg 1$. The transition temperature $T_c$ vanishes with the population size $N$ as $T_c \simeq 2/\ln N$ in complete graph. Besides, the distribution of residence times $t_r$ in the bimodal phase decays approximately as $t_r^{-3/2}$. Within the oscillatory regime, we find a stochastic resonance-like phenomenon at a given temperature $T^*$. Also, mean-field analytical results show that the opinion oscillations reach a maximum amplitude at an intermediate temperature, and that exhibit a lag respect to the field that decreases with $T$.


title: Cognitive Hierarchies in Multi-Stage Games of Incomplete Information: Theory and Experiment

abstract: Sequential equilibrium is the conventional approach for analyzing multi-stage games of incomplete information. It relies on mutual consistency of beliefs. To relax mutual consistency, I theoretically and experimentally explore the dynamic cognitive hierarchy (DCH) solution. One property of DCH is that the solution can vary between two different games sharing the same reduced normal form, i.e., violation of invariance under strategic equivalence. I test this prediction in a laboratory experiment using two strategically equivalent versions of the dirty-faces game. The game parameters are calibrated to maximize the expected difference in behavior between the two versions, as predicted by DCH. The experimental results indicate significant differences in behavior between the two versions, and more importantly, the observed differences align with DCH. This suggests that implementing a dynamic game experiment in reduced normal form (using the "strategy method") could lead to distortions in behavior.


title: Towards cumulative race time regression in sports: I3D ConvNet transfer learning in ultra-distance running events

abstract: Predicting an athlete's performance based on short footage is highly challenging. Performance prediction requires high domain knowledge and enough evidence to infer an appropriate quality assessment. Sports pundits can often infer this kind of information in real-time. In this paper, we propose regressing an ultra-distance runner cumulative race time (CRT), i.e., the time the runner has been in action since the race start, by using only a few seconds of footage as input. We modified the I3D ConvNet backbone slightly and trained a newly added regressor for that purpose. We use appropriate pre-processing of the visual input to enable transfer learning from a specific runner. We show that the resulting neural network can provide a remarkable performance for short input footage: 18 minutes and a half mean absolute error in estimating the CRT for runners who have been in action from 8 to 20 hours. Our methodology has several favorable properties: it does not require a human expert to provide any insight, it can be used at any moment during the race by just observing a runner, and it can inform the race staff about a runner at any given time.


title: Memory capacity of adaptive flow networks

abstract: Biological flow networks adapt their network morphology to optimise flow while being exposed to external stimuli from different spatial locations in their environment. These adaptive flow networks retain a memory of the stimulus location in the network morphology. Yet, what limits this memory and how many stimuli can be stored is unknown. Here, we study a numerical model of adaptive flow networks by applying multiple stimuli subsequently. We find strong memory signals for stimuli imprinted for a long time into young networks. Consequently, networks can store many stimuli for intermediate stimulus duration, which balance imprinting and ageing.


title: One dimensional non-Hausdorff manifolds and foliations of the plane

abstract: The original article titled "Vari\'et\'es (non s\'epar\'ees) \`a une dimension et structures feuillet\'ees du plan" was published in 1957 in French in L'Enseignement Math\'ematique. It establishes a beautiful connection between foliations of the plane and non-Hausdorff $1$-dimensional manifolds arising naturally as leaf spaces of the foliations. Since its appearance, this theory has paved the way for several results concerning dynamical systems and foliations of the plane and $2$-manifolds. Haefliger and Reeb's article inspires many results in the theory of foliation of $3$-manifolds as well: we refer the interested reader to Danny Calegari's book on the topic. Haefliger and Reeb's article also has been applied to areas outside topological dynamics. This article has been referenced in $43$ papers to-date and has helped build many nice results. In the literature, the main theorem of this article has been commonly referred to as Haefliger-Reeb theory or "a classical result by Haefliger and Reeb". However, to the best of our knowledge, no English version of this article is currently available. We have kept the article entirely unchanged except to add figures and correct a few typographical errors. We hope that this translation will be useful for the broader audience.


title: Bitext Mining for Low-Resource Languages via Contrastive Learning

abstract: Mining high-quality bitexts for low-resource languages is challenging. This paper shows that sentence representation of language models fine-tuned with multiple negatives ranking loss, a contrastive objective, helps retrieve clean bitexts. Experiments show that parallel data mined from our approach substantially outperform the previous state-of-the-art method on low resource languages Khmer and Pashto.


title: Robustness to Unbounded Smoothness of Generalized SignSGD

abstract: Traditional analyses in non-convex optimization typically rely on the smoothness assumption, namely requiring the gradients to be Lipschitz. However, recent evidence shows that this smoothness condition does not capture the properties of some deep learning objective functions, including the ones involving Recurrent Neural Networks and LSTMs. Instead, they satisfy a much more relaxed condition, with potentially unbounded smoothness. Under this relaxed assumption, it has been theoretically and empirically shown that the gradient-clipped SGD has an advantage over the vanilla one. In this paper, we show that clipping is not indispensable for Adam-type algorithms in tackling such scenarios: we theoretically prove that a generalized SignSGD algorithm can obtain similar convergence rates as SGD with clipping but does not need explicit clipping at all. This family of algorithms on one end recovers SignSGD and on the other end closely resembles the popular Adam algorithm. Our analysis underlines the critical role that momentum plays in analyzing SignSGD-type and Adam-type algorithms: it not only reduces the effects of noise, thus removing the need for large mini-batch in previous analyses of SignSGD-type algorithms, but it also substantially reduces the effects of unbounded smoothness and gradient norms. We also compare these algorithms with popular optimizers on a set of deep learning tasks, observing that we can match the performance of Adam while beating the others.


title: A Universal Constraint on Computational Rates in Physical Systems

abstract: Conventional computing has many sources of heat dissipation, but one of these--the Landauer limit--poses a fundamental lower bound of 1 bit of entropy per bit erased. 'Reversible Computing' avoids this source of dissipation, but is dissipationless computation possible? In this paper, a general proof is given for open quantum systems showing that a computer thermally coupled to its environment will necessarily dissipate entropy (and hence heat). Specifically, a lower bound is obtained that corresponds to the adiabatic regime, in which the amount of entropy dissipated per computational operation is proportional to the rate of computation.


title: Modelling Latent Dynamics of StyleGAN using Neural ODEs

abstract: In this paper, we propose to model the video dynamics by learning the trajectory of independently inverted latent codes from GANs. The entire sequence is seen as discrete-time observations of a continuous trajectory of the initial latent code, by considering each latent code as a moving particle and the latent space as a high-dimensional dynamic system. The latent codes representing different frames are therefore reformulated as state transitions of the initial frame, which can be modeled by neural ordinary differential equations. The learned continuous trajectory allows us to perform infinite frame interpolation and consistent video manipulation. The latter task is reintroduced for video editing with the advantage of requiring the core operations to be applied to the first frame only while maintaining temporal consistency across all frames. Extensive experiments demonstrate that our method achieves state-of-the-art performance but with much less computation. Code is available at https://github.com/weihaox/dynode_released.


title: Microwave spectroscopy of interacting Andreev spins

abstract: Andreev bound states are fermionic states localized in weak links between superconductors which can be occupied with spinful quasiparticles. Microwave experiments using superconducting circuits with InAs/Al nanowire Josephson junctions have recently enabled probing and coherent manipulation of Andreev states but have remained limited to zero or small fields. Here we use a flux-tunable superconducting circuit in external magnetic fields up to 1T to perform spectroscopy of spin-polarized Andreev states up to ~250 mT, beyond which the spectrum becomes gapless. We identify singlet and triplet states of two quasiparticles occupying different Andreev states through their dispersion in magnetic field. These states are split by exchange interaction and couple via spin-orbit coupling, analogously to two-electron states in quantum dots. We also show that the magnetic field allows to drive a direct spin-flip transition of a single quasiparticle trapped in the junction. Finally, we measure a gate- and field-dependent anomalous phase shift of the Andreev spectrum, of magnitude up to approximately $0.7\pi$. Our observations demonstrate new ways to manipulate Andreev states in a magnetic field and reveal spin-polarized triplet states that carry supercurrent.


title: A Beginner's Guide to Homological Algebra: A Comprehensive Introduction for Students

abstract: Homological algebra is often understood as the translator between the world of topology and algebra. However, this branch of mathematics is worth studying by itself, given that it provides fascinating perspectives about other disciplines, most notably, category theory. In this paper, we seek to provide an introductory guide for advanced students of mathematics and related specialties seeking to get started on homological algebra, covering the necessary central topics to later delve deeper into more complex aspects of this field and beyond. This work starts by presenting the notion of chain complexes of algebraic structures, and then moves into exploring homology modules and chain homotopies. Next, we provide an overview of projective resolutions and conclude by entering the world of category theory by looking at Tor functors.


title: FirmCore Decomposition of Multilayer Networks

abstract: A key graph mining primitive is extracting dense structures from graphs, and this has led to interesting notions such as $k$-cores which subsequently have been employed as building blocks for capturing the structure of complex networks and for designing efficient approximation algorithms for challenging problems such as finding the densest subgraph. In applications such as biological, social, and transportation networks, interactions between objects span multiple aspects. Multilayer (ML) networks have been proposed for accurately modeling such applications. In this paper, we present FirmCore, a new family of dense subgraphs in ML networks, and show that it satisfies many of the nice properties of $k$-cores in single-layer graphs. Unlike the state of the art core decomposition of ML graphs, FirmCores have a polynomial time algorithm, making them a powerful tool for understanding the structure of massive ML networks. We also extend FirmCore for directed ML graphs. We show that FirmCores and directed FirmCores can be used to obtain efficient approximation algorithms for finding the densest subgraphs of ML graphs and their directed counterparts. Our extensive experiments over several real ML graphs show that our FirmCore decomposition algorithm is significantly more efficient than known algorithms for core decompositions of ML graphs. Furthermore, it returns solutions of matching or better quality for the densest subgraph problem over (possibly directed) ML graphs.


title: Companion Shocking Fits to the 2018 ZTF Sample of SNe Ia Are Consistent with Single-Degenerate Progenitor Systems

abstract: The early lightcurves of Type Ia supernovae (SNe Ia) can be used to test predictions about their progenitor systems. If the progenitor system consists of a single white dwarf in a binary with a Roche-lobe-overflowing non-degenerate stellar companion, then the SN ejecta should collide with that companion soon after the explosion and get shock-heated, leaving an early UV excess in the lightcurve. This excess would only be observable for events with favorable viewing angles, $\sim$10\% of the time. We model the 2018 ZTF sample of 127 SNe Ia using companion shocking models, and recover an observed early excess rate of $12.0\pm3.6\%$, consistent both with several other rates calculated throughout the literature, and with the expectation that SNe Ia predominantly occur in single-degenerate systems. We observe early excesses only in spectroscopically normal SNe Ia, in contradiction to the claim that such excesses occur more frequently in overluminous SNe Ia. We also show that the detection of early excesses can be methodology-dependent. We encourage the observation of large samples of SNe Ia with high-cadence multiwavelength early data in order to test the statistical predictions of SN Ia progenitor models, and we also encourage the refinement of existing models.


title: Blockchain Simulators: A Systematic Mapping Study

abstract: Recently, distributed ledger technologies like blockchain have been proliferating and have attracted interest from the academic community, government, and industry. A wide range of blockchain solutions has been introduced, such as Bitcoin, Ethereum, and Hyperledger technologies in the literature. However, tools for evaluating these solutions and their applications are still lacking, limiting the exploration of their potentiality and associated challenges/limitations. That is, experimenting with real blockchain networks usually requires a solid budget; and thus, sophisticated blockchain simulators can facilitate designing and evaluating solutions before the actual implementation stage. The quality of such simulators depends on several factors such as usability, reliability, provided capabilities, and supported features. This paper aims to provide a systemic mapping review of blockchain simulators focusing on these quality factors. This paper also sheds light on the configuration parameters (inputs) and produced metrics (outputs) supported by each simulator. Furthermore, it investigates which metrics supported by each simulator are scientifically validated/evaluated. Moreover, code quality comparison is carried out to assess the source code of the covered simulators. The results reveal that no simulator fully covers the wide operational range of features and capabilities of existing blockchain technologies. However, several promising efforts exist in the domain of blockchain simulation with interesting and useful features. Finally, we discuss the subject of blockchain simulation and provide our insight into the matter.


title: Graph Neural Networks and Representation Embedding for Table Extraction in PDF Documents

abstract: Tables are widely used in several types of documents since they can bring important information in a structured way. In scientific papers, tables can sum up novel discoveries and summarize experimental results, making the research comparable and easily understandable by scholars. Several methods perform table analysis working on document images, losing useful information during the conversion from the PDF files since OCR tools can be prone to recognition errors, in particular for text inside tables. The main contribution of this work is to tackle the problem of table extraction, exploiting Graph Neural Networks. Node features are enriched with suitably designed representation embeddings. These representations help to better distinguish not only tables from the other parts of the paper, but also table cells from table headers. We experimentally evaluated the proposed approach on a new dataset obtained by merging the information provided in the PubLayNet and PubTables-1M datasets.


title: Transfer Learning-based State of Health Estimation for Lithium-ion Battery with Cycle Synchronization

abstract: Accurately estimating a battery's state of health (SOH) helps prevent battery-powered applications from failing unexpectedly. With the superiority of reducing the data requirement of model training for new batteries, transfer learning (TL) emerges as a promising machine learning approach that applies knowledge learned from a source battery, which has a large amount of data. However, the determination of whether the source battery model is reasonable and which part of information can be transferred for SOH estimation are rarely discussed, despite these being critical components of a successful TL. To address these challenges, this paper proposes an interpretable TL-based SOH estimation method by exploiting the temporal dynamic to assist transfer learning, which consists of three parts. First, with the help of dynamic time warping, the temporal data from the discharge time series are synchronized, yielding the warping path of the cycle-synchronized time series responsible for capacity degradation over cycles. Second, the canonical variates retrieved from the spatial path of the cycle-synchronized time series are used for distribution similarity analysis between the source and target batteries. Third, when the distribution similarity is within the predefined threshold, a comprehensive target SOH estimation model is constructed by transferring the common temporal dynamics from the source SOH estimation model and compensating the errors with a residual model from the target battery. Through a widely-used open-source benchmark dataset, the estimation error of the proposed method evaluated by the root mean squared error is as low as 0.0034 resulting in a 77% accuracy improvement compared with existing methods.


title: Fate of exceptional points in the presence of nonlinearities

abstract: The non-Hermitian dynamics of open systems deal with how intricate coherent effects of a closed system intertwine with the impact of coupling to an environment. The system-environment dynamics can then lead to so-called exceptional points, which are the open-system marker of phase transitions, i.e., the closing of spectral gaps in the complex spectrum. Even in the ubiquitous example of the damped harmonic oscillator, the dissipative environment can lead to an exceptional point, separating between under-damped and over-damped dynamics at a point of critical damping. Here, we examine the fate of this exceptional point in the presence of strong correlations, i.e., for a nonlinear oscillator. By employing a functional renormalization group approach, we identify non-perturbative regimes of this model where the nonlinearity makes the system more robust against the influence of dissipation and can remove the exceptional point altogether. The melting of the exceptional point occurs above a critical nonlinearity threshold. Interestingly, the exceptional point melts faster with increasing temperatures, showing a surprising flow to coherent dynamics when coupled to a warm environment.


title: Thermodynamic Skewness Relation From Detailed Fluctuation Theorem

abstract: The detailed fluctuation theorem (DFT) is a statement about the asymmetry in the statistics of the entropy production. Consequences of the DFT are the second law of thermodynamics and the thermodynamics uncertainty relation (TUR), which translate into lower bounds for the mean and variance of currents, respectively. However, far from equilibrium, mean and variance are not enough to characterize the underlying distribution of the entropy production. The fluctuations are not necessarily Gaussian (nor symmetric), which means its skewness could be nonzero. We prove that the DFT imposes a negative tight lower bound for the skewness of the entropy production as a function of the mean. As application, we check the bound in the heat exchange problem between two thermal reservoirs mediated by a qubit swap engine.


title: Investigating the Requirements for Building a Blockchain Simulator for IoT Applications

abstract: The pervasiveness of the Internet of Things (IoT) has enabled the administration of a large number of intelligent devices. However, IoT is based on centralised models, which introduce a number of problems, such as a single point of failure and security risks. Blockchain may offer a viable option for addressing these concerns. Practically, both blockchain and IoT are complex technologies posing further challenges in assessing application performance. The availability of a reliable simulation environment for Blockchain based IoT applications would be a major aid in the development and evaluation of such applications. Our research has found that currently there are no simulators with a comprehensive set of features, for the development and evaluation of blockchain based IoT applications, which is the main motivation for our work. The purpose of this study is to gather the opinions of experts regarding the creation of a simulation environment for IoT based blockchain applications. To do this, we utilise two separate investigations. First, a questionnaire is developed to ensure that the development of such simulation software would be of significant use. Second, interviews with participants are performed to gain their perspectives on the primary issues they face with blockchain-based IoT applications. In addition, the interviews focused on collecting the perspectives of participants on how blockchain may improve IoT and how to identify blockchain's applicability in IoT. Our findings demonstrate that the participants had a great deal of confidence in blockchain to resolve IoT issues. However, they lack the tools necessary to assess this concept. This highlights their requirement for a simulator to analyse the integration of blockchain and IoT.


title: Accelerating Monte-Carlo Tree Search on CPU-FPGA Heterogeneous Platform

abstract: Monte Carlo Tree Search (MCTS) methods have achieved great success in many Artificial Intelligence (AI) benchmarks. The in-tree operations become a critical performance bottleneck in realizing parallel MCTS on CPUs. In this work, we develop a scalable CPU-FPGA system for Tree-Parallel MCTS. We propose a novel decomposition and mapping of MCTS data structure and computation onto CPU and FPGA to reduce communication and coordination. High scalability of our system is achieved by encapsulating in-tree operations in an SRAM-based FPGA accelerator. To lower the high data access latency and inter-worker synchronization overheads, we develop several hardware optimizations. We show that by using our accelerator, we obtain up to $35\times$ speedup for in-tree operations, and $3\times$ higher overall system throughput. Our CPU-FPGA system also achieves superior scalability wrt number of parallel workers than state-of-the-art parallel MCTS implementations on CPU.


title: Weighing Exo-Atmospheres: A novel mid-resolution spectral mode for SCALES

abstract: SCALES (Slicer Combined with an Array of Lenslets for Exoplanet Spectroscopy) is a 2 to 5 micron high-contrast lenslet-based Integral Field Spectrograph (IFS) designed to characterize exoplanets and their atmospheres. Like other lenslet-based IFSs, SCALES produces a short micro-spectrum of each lenslet's micro-pupil. We have developed an image slicer that sits behind the lenslet array and dissects and rearranges a subset of micro-pupils into a pseudo-slit. The combination lenslet array and slicer (or slenslit) allows SCALES to produce much longer spectra, thereby increasing the spectra resolution by over an order of magnitude and allowing for comparisons to atmospheric modeling at unprecedented resolution. This proceeding describes the design and performance of the slenslit.


title: Data augmentation on graphs for table type classification

abstract: Tables are widely used in documents because of their compact and structured representation of information. In particular, in scientific papers, tables can sum up novel discoveries and summarize experimental results, making the research comparable and easily understandable by scholars. Since the layout of tables is highly variable, it would be useful to interpret their content and classify them into categories. This could be helpful to directly extract information from scientific papers, for instance comparing performance of some models given their paper result tables. In this work, we address the classification of tables using a Graph Neural Network, exploiting the table structure for the message passing algorithm in use. We evaluate our model on a subset of the Tab2Know dataset. Since it contains few examples manually annotated, we propose data augmentation techniques directly on the table graph structures. We achieve promising preliminary results, proposing a data augmentation method suitable for graph-based table representation.


title: A note on gluing via fiber products in the (classical) BV-BFV formalism

abstract: In classical field theory, gluing spacetime manifolds along boundary corresponds to taking a fiber product of the corresponding spaces of fields (as differential graded Fr\'echet manifolds) up to homotopy. We construct this homotopy explicitly in several examples in the setting of BV-BFV formalism (Batalin--Vilkovisky formalism with cutting--gluing).


title: DeepPicarMicro: Applying TinyML to Autonomous Cyber Physical Systems

abstract: Running deep neural networks (DNNs) on tiny Micro-controller Units (MCUs) is challenging due to their limitations in computing, memory, and storage capacity. Fortunately, recent advances in both MCU hardware and machine learning software frameworks make it possible to run fairly complex neural networks on modern MCUs, resulting in a new field of study widely known as TinyML. However, there have been few studies to show the potential for TinyML applications in cyber physical systems (CPS). In this paper, we present DeepPicarMicro, a small self-driving RC car testbed, which runs a convolutional neural network (CNN) on a Raspberry Pi Pico MCU. We apply a state-of-the-art DNN optimization to successfully fit the well-known PilotNet CNN architecture, which was used to drive NVIDIA's real self-driving car, on the MCU. We apply a state-of-art network architecture search (NAS) approach to find further optimized networks that can effectively control the car in real-time in an end-to-end manner. From an extensive systematic experimental evaluation study, we observe an interesting relationship between the accuracy, latency, and control performance of a system. From this, we propose a joint optimization strategy that takes both accuracy and latency of a model in the network architecture search process for AI enabled CPS.


title: Simultaneous Suppression of Thermal Phase Noise and Relative Intensity Noise in a Fiber Optic Gyroscope

abstract: The short-term sensitivity of a kilometer-long fiber-optic gyroscope is limited mainly by thermal phase noise and relative intensity noise. Increasing the phase modulation frequency decreases the thermal phase noise but not the relative intensity noise since it behaves as white noise. Here, we propose and experimentally demonstrate that the angular random walk can be effectively decreased by suppressing relative intensity noise at the modulation frequency and its third-order harmonic using direct feedback to the drive current of a superluminescent diode. Our simultaneous suppression of thermal phase noise and relative intensity noise yields an angular random walk of $15\,\mu\mathrm{deg}/\sqrt{\mathrm{h}}$ and a bias instability of $33\,\mu\mathrm{deg}/\mathrm{h}$ using a fiber coil with a length of $5\,$km and an effective area of $280\,\mathrm{m^2}$ for a measurement time of 40 hours.


title: $k$-slant distributions

abstract: Inspired by the concepts of slant distribution and slant submanifold, with their variants of hemi-slant, semi-slant, bi-slant, or almost bi-slant, we introduce the more general concepts of $k$-slant distribution and $k$-slant submanifold in the settings of an almost Hermitian, an almost product Riemannian, an almost contact metric, and an almost paracontact metric manifold and study some of their properties. We prove that, for any proper $k$-slant distribution in the tangent bundle of a Riemannian manifold, there exists another one in its orthogonal complement, and we establish basic relations (metric properties, formulae relating the involved tensor fields, conformal properties) between them. Furthermore, allowing the slant angles to depend on the points of the manifold, we generalize these concepts and those of pointwise slant distribution and pointwise slant submanifold to the concepts of $k$-pointwise slant distribution and $k$-pointwise slant submanifold in the above-mentioned settings. For any $k$-pointwise slant distribution, we prove the existence of a corresponding one in its orthogonal complement and reveal basic relations between them. We also provide sufficient conditions for $k$-pointwise slant distributions to become $k$-slant distributions and establish other related results. By the end, for the fulfilment of some specific requirements, we introduce a special class of $k$-pointwise slant distributions, that of pointwise $k$-slant distributions, and the corresponding class of submanifolds, pointwise $k$-slant submanifolds, which is slightly more general than the class of generic submanifolds in sense of Ronsse, getting new results.


title: Unidentified aerial phenomena I. Observations of events

abstract: NASA commissioned a research team to study Unidentified Aerial Phenomena (UAP), observations of events that cannot scientifically be identified as known natural phenomena. The Main Astronomical Observatory of NAS of Ukraine conducts an independent study of UAP also. For UAP observations, we used two meteor stations. Observations were performed with colour video cameras in the daytime sky. We have developed a special observation technique, for detecting and evaluating UAP characteristics. According to our data, there are two types of UAP, which we conventionally call: (1) Cosmics, and (2) Phantoms. We note that Cosmics are luminous objects, brighter than the background of the sky. Phantoms are dark objects, with contrast from several to about 50 per cent. We observe a significant number of objects whose nature is not clear. Flights of single, group and squadrons of the ships were detected, moving at speeds from 3 to 15 degrees per second. Some bright objects exhibit regular brightness variability in the range of 10 - 20 Hz. We use colourimetry methods to determine of distance to objects and evaluate their colour characteristics. Objects RGB colours of the Adobe colour system had converted to the Johnson BVR astronomical colour system using the colour corrections. Phantom shows the colour characteristics inherent in an object with zero albedos. It is a completely black body that does not emit and absorbs all the radiation falling on it. We see an object because it shields radiation due to Rayleigh scattering. An object contrast makes it possible to estimate the distance using colourimetric methods. Phantoms are observed in the troposphere at distances up to 10 - 12 km. We estimate their size from 3 to 12 meters and speeds up to 15 km/s.


title: The essential adjointness of pseudo-differential operators on $\mathbb{Z}^n$

abstract: In the setting of the lattice $\mathbb{Z}^n$ we consider a pseudo-differential operator $A$ whose symbol belongs to a class defined on $\mathbb{Z}^n\times \mathbb{T}^n$, where $\mathbb{T}^n$ is the $n$-torus. We realize $A$ as an operator acting between the discrete Sobolev spaces $H^{s_j}(\mathbb{Z}^n)$, $s_j\in\mathbb{R}$, $j=1,2$, with the discrete Schwartz space serving as the domain of $A$. We provide a sufficient condition for the essential adjointness of the pair $(A,\,A^{\dagger})$, where $A^{\dagger}$ is the formal adjoint of $A$.


title: Investment in the common good: free rider effect and the stability of mixed strategy equilibria

abstract: In the game of investment in the common good, the free rider problem can delay the stakeholders' actions in the form of a mixed strategy equilibrium. However, it has been recently shown that the mixed strategy equilibria of the stochastic war of attrition are destabilized by even the slightest degree of asymmetry between the players. Such extreme instability is contrary to the widely accepted notion that a mixed strategy equilibrium is the hallmark of the war of attrition. Motivated by this quandary, we search for a mixed strategy equilibrium in a stochastic game of investment in the common good. Our results show that, despite asymmetry, a mixed strategy equilibrium exists if the model takes into account the repeated investment opportunities. The mixed strategy equilibrium disappears only if the asymmetry is sufficiently high. Since the mixed strategy equilibrium is less efficient than pure strategy equilibria, it behooves policymakers to prevent it by promoting a sufficiently high degree of asymmetry between the stakeholders through, for example, asymmetric subsidy.


title: The high-Reynolds-number stratified wake of a slender body and its comparison with a bluff-body wake

abstract: The high-Reynolds number stratified wake of a slender body is studied using a high-resolution hybrid simulation. The wake generator is a 6:1 prolate spheroid with a tripped boundary layer, the diameter-based body Reynolds number is $Re= U_\infty D/\nu = 10^5$, and the body Froude numbers are $Fr=U_\infty/ND=\{2,10,\infty\}$. The wake defect velocity ($U_d$) decays following three stages with different wake decay rates \citep{Spedding1997} as for a bluff body. However, the transition points among stages do not follow the expected $Nt = Nx/U_\infty$ values. Comparison with the wake of a circular disk in similar conditions \citep{Chongsiripinyo2020} quantifies the influence of the wake generator - bluff versus slender - in stratified flow. The strongly stratified $Fr=2$ wake is in a resonant state. The steady lee waves strongly modulate the mean flow and, relative to the disk, the $Fr=2$ spheroid wake shows an earlier transition from the non-equilibrium (NEQ) stage to the quasi-two-dimensional (Q2D) stage. The NEQ-Q2D transition is followed by a sharp increase in the turbulent kinetic energy and horizontal wake meanders. At $Fr=10$, the start of the NEQ stage is delayed. Transfers between kinetic energy and potential energy reservoirs (both mean and turbulence) are analyzed and the flows are compared in phase space (local Froude and Reynolds number as coordinates). Overall, the results of this study point to the difficulty of finding a universal framework for stratified wake evolution, independent of the features of the body, and provide insights into how buoyancy effects depend on the wake generator.


title: Ultrafast optical nanoscopy of carrier dynamics in silicon nanowires

abstract: Carrier distribution and dynamics in semiconductor materials often govern their physical properties that are critical to functionalities and performance in industrial applications. The continued miniaturization of electronic and photonic devices calls for tools to probe carrier behavior in semiconductors simultaneously at the picosecond time and nanometer length scales. Here, we report pump-probe optical nanoscopy in the visible-near-infrared spectral region to characterize the carrier dynamics in silicon nanostructures. By coupling experiments with the point-dipole model, we resolve the size-dependent photoexcited carrier lifetime in individual silicon nanowires. We further demonstrate local carrier decay time mapping in silicon nanostructures with a sub-50 nm spatial resolution. Our study enables the nanoimaging of ultrafast carrier kinetics, which will find promising applications in the future design of a broad range of electronic, photonic, and optoelectronic devices.


title: Variational quantum algorithms for local Hamiltonian problems

abstract: Variational quantum algorithms (VQAs) are a modern family of quantum algorithms designed to solve optimization problems using a quantum computer. Typically VQAs rely on a feedback loop between the quantum device and a classical optimization algorithm. The appeal of VQAs lies in their versatility, resistance to noise, and ability to demonstrate some results even with circuits of small depth. We primarily focus on the algorithm called variational quantum eigensolver (VQE), which takes a qubit Hamiltonian and returns its approximate ground state. We first present our numerical findings regarding VQE applied to two spin models and a variant of the Hubbard model. Next, we briefly touch the topic of quantum machine learning by developing a quantum classifier to partition quantum data. We further study the phenomenon of vanishing derivatives in VQAs, also known as barren plateaus phenomenon. We derive a new lower bound on variance of the derivatives, which depends on the causal structure of the ansatz circuit and the individual terms entering the Pauli decomposition of the problem Hamiltonian. In the final chapter of the thesis, we present our results on bounding the fidelity of experimentally prepared Clifford states using their parent Hamiltonians.


title: Multinomial Cluster-Weighted Models for High-Dimensional Data

abstract: Modeling of high-dimensional data is very important to categorize different classes. We develop a new mixture model called Multinomial cluster-weighted model (MCWM). We derive the identifiability of a general class of MCWM. We estimate the proposed model through Expectation-Maximization (EM) algorithm via an iteratively reweighted least squares (EM-IRLS) and Stochastic Gradient Descent (EM-SGD). Model selection is carried out using different information criteria. Various Adjusted Rand Indices are considered as a different measure of accuracy. The clustering performance of the proposed model is investigated using simulated and real datasets. MCWM shows excellent clustering results via performance measures such as Accuracy and Area under the ROC curve.


title: Flow past an inclined spheroid in homogeneous and stratified environments

abstract: Large-eddy simulations (LES) are performed to study the flow past a 6:1 prolate spheroid placed at an angle of incidence of $\alpha = 10^{\circ}$. The diameter-based Reynolds number ($Re = U_{\infty}D/\nu$) is set to a value of $5\times10^{3}$ and four values of diameter-based Froude numbers ($Fr = U_\infty/ND$) are analyzed: $Fr = \infty, 6, 1.9,$ and $1$. Visualizations of coefficient of pressure ($C_p$) and friction ($C_f$) contours reveal asymmetry in the $Fr = \infty$ and $6$ flows while, at $Fr = 1$ and $Fr = 1.9$, the flow over body does not have any visible asymmetry. This finding is further corroborated through the analysis of force coefficients on the body. The changes in the pressure coefficients ($C_p$), friction coefficients ($C_f$), and drag coefficients ($C_d$) with the Froude number are described in detail for $\alpha = 10^{\circ}$. We also present the analyses of forces on the body at $\alpha = 0^{\circ}$ angle of incidence for comparison with the $\alpha = 10^{\circ}$ cases.


title: POPDx: An Automated Framework for Patient Phenotyping across 392,246 Individuals in the UK Biobank Study

abstract: Objective For the UK Biobank standardized phenotype codes are associated with patients who have been hospitalized but are missing for many patients who have been treated exclusively in an outpatient setting. We describe a method for phenotype recognition that imputes phenotype codes for all UK Biobank participants. Materials and Methods POPDx (Population-based Objective Phenotyping by Deep Extrapolation) is a bilinear machine learning framework for simultaneously estimating the probabilities of 1,538 phenotype codes. We extracted phenotypic and health-related information of 392,246 individuals from the UK Biobank for POPDx development and evaluation. A total of 12,803 ICD-10 diagnosis codes of the patients were converted to 1,538 Phecodes as gold standard labels. The POPDx framework was evaluated and compared to other available methods on automated multi-phenotype recognition. Results POPDx can predict phenotypes that are rare or even unobserved in training. We demonstrate substantial improvement of automated multi-phenotype recognition across 22 disease categories, and its application in identifying key epidemiological features associated with each phenotype. Conclusions POPDx helps provide well-defined cohorts for downstream studies. It is a general purpose method that can be applied to other biobanks with diverse but incomplete data.


title: Decentralized Optimization with Distributed Features and Non-Smooth Objective Functions

abstract: We develop a new consensus-based distributed algorithm for solving learning problems with feature partitioning and non-smooth convex objective functions. Such learning problems are not separable, i.e., the associated objective functions cannot be directly written as a summation of agent-specific objective functions. To overcome this challenge, we redefine the underlying optimization problem as a dual convex problem whose structure is suitable for distributed optimization using the alternating direction method of multipliers (ADMM). Next, we propose a new method to solve the minimization problem associated with the ADMM update step that does not rely on any conjugate function. Calculating the relevant conjugate functions may be hard or even unfeasible, especially when the objective function is non-smooth. To obviate computing any conjugate function, we solve the optimization problem associated with each ADMM iteration in the dual domain utilizing the block coordinate descent algorithm. Unlike the existing related algorithms, the proposed algorithm is fully distributed and does away with the conjugate of the objective function. We prove theoretically that the proposed algorithm attains the optimal centralized solution. We also confirm its network-wide convergence via simulations.


title: Temporary Laser Inter-Satellite Links in Free-Space Optical Satellite Networks

abstract: Laser inter-satellite links (LISLs) between satellites in a free-space optical satellite network (FSOSN) can be divided into two classes: permanent LISLs (PLs) and temporary LISLs (TLs). TLs are not desirable in next-generation FSOSNs (NG-FSOSNs) due to high LISL setup time, but they may become feasible in next-next-generation FSOSNs (NNG-FSOSNs). Using the satellite constellation for Phase I of Starlink, we study the impact of TLs on network latency in an NG-FSOSN (which has only PLs) versus an NNG-FSOSN (which has PLs and TLs) under different long-distance inter-continental data communications scenarios, including Sydney-Sao Paulo, Toronto-Istanbul, Madrid-Tokyo, and New York-Jakarta, and different LISL ranges for satellites, including 659.5 km, 1,319 km, 1,500 km, 1,700 km, 2,500 km, 3,500 km, and 5,016 km. It is observed from the results that TLs provide higher satellite connectivity and thereby higher network connectivity, and they lead to lower average network latency for the NNG-FSOSN compared to the NG-FSOSN in all scenarios at all LISL ranges. In comparison with the NG-FSOSN, the improvement in latency with the NNG-FSOSN is significant at LISL ranges of 1,500 km, 1,700 km, and 2,500 km, where the improvement is 16.83 ms, 23.43 ms, and 18.20 ms, respectively, for the Sydney-Sao Paulo inter-continental connection. For the Toronto-Istanbul, Madrid-Tokyo, and New York-Jakarta inter-continental connections, the improvement is 14.58 ms, 23.35 ms, and 23.52 ms, respectively, at the 1,700 km LISL range.


title: Reliability of COVID-19 data and government policies

abstract: We study how available data on COVID-19 cases and deaths in different countries are reliable. Our analysis is based on a modification of the law of anomalous numbers, the Newcomb-Benford law, applied to the daily number of deaths and new cases in each country. We first revisit the Newcomb-Benford law and show how to avoid false negative compliance of the data. We then compared deviation from this law, to a number of social and economic indices for each country by computing the Spearman rank order correlation between each index and the \c{hi}2 deviation of COVID- 19 data to the modified NB law. A similar analysis for excess deaths for the same countries with sufficient available data was performed. We conclude that in general less democratic, less transparent and more corrupt countries tend to have data of lesser quality. We also discuss the limitations of the present approach.


title: A thermal model with AC Josephson effect for a shunted superconducting weak-link

abstract: Superconducting weak-link (WL), behaving like a Josephson junction (JJ), is fundamental to many superconducting devices such as nanoSQUIDs, single-photon detectors, and bolometers. The interplay between unique nonlinear dynamics and inevitable Joule heating in a JJ leads to new characteristics. Here, we report a time-dependent model incorporating thermal effect in the AC Josephson regime for a Josephson WL shunted by a resistor together with an inductor to investigate the dynamics as well as the resulting current-voltage characteristics. We find that the dynamic regime where phase and temperature oscillate simply widens due to a pure resistive shunt. However, a significant inductive time-scale in the shunt loop, competing with the thermal time-scale, introduces high-frequency relaxation oscillations in the dynamic regime. Based on numerical analysis, we present state diagrams for different parameter regimes. Our model is a guide for better controlling the parameters in the experiments of WL-based devices.


title: Why Deep Learning's Performance Data Are Misleading

abstract: This is a theoretical paper, as a companion paper of the keynote talk at the same conference AIEE 2023. In contrast to conscious learning, many projects in AI have employed so-called "deep learning" many of which seemed to give impressive performance. This paper explains that such performance data are deceptively inflated due to two misconducts: "data deletion" and "test on training set". This paper clarifies "data deletion" and "test on training set" in deep learning and why they are misconducts. A simple classification method is defined, called Nearest Neighbor With Threshold (NNWT). A theorem is established that the NNWT method reaches a zero error on any validation set and any test set using the two misconducts, as long as the test set is in the possession of the author and both the amount of storage space and the time of training are finite but unbounded like with many deep learning methods. However, many deep learning methods, like the NNWT method, are all not generalizable since they have never been tested by a true test set. Why? The so-called "test set" was used in the Post-Selection step of the training stage. The evidence that misconducts actually took place in many deep learning projects is beyond the scope of this paper.


title: Autonomous Driving Vehicles Using Adaptive Learning Method for Data Fusion

abstract: This paper presents an adaptive learning method for data fusion in autonomous driving vehicles. The localization is based on the integration of Inertial Measurement Unit (IMU) with two Real-Time Kinematic (RTK) Global Positioning System (GPS) units in an adaptive Kalman filter (KF). The observability analysis reveals that $i$) integration of a single GPS with IMU does not constitute an observable system; $ii$) integration of two GPS units with IMU results in a locally observable system provided that the line connecting two GPS antennas is not parallel with the vector of the measured acceleration, i.e., the sum of inertial and gravitational accelerations. The latter case makes it possible to compensate for the error in the estimated orientation due to gyro drift and its bias without needing additional instruments for absolute orientation measurements, e.g., a magnetic compass. Moreover, in order to cope with the fact that GPS systems sometimes lose their signal and receive inaccurate position data, the self-tuning filter estimates the covariance matrix associated with the GPS measurement noise. This allows the KF to incorporate GPS measurements in the data fusion process heavily only when the information received by GPS becomes reliably available.


title: Pay No Attention to the Model Behind the Curtain

abstract: Many widely used models amount to an elaborate means of making up numbers--but once a number has been produced, it tends to be taken seriously and its source (the model) is rarely examined carefully. Many widely used models have little connection to the real-world phenomena they purport to explain. Common steps in modeling to support policy decisions, such as putting disparate things on the same scale, may conflict with reality. Not all costs and benefits can be put on the same scale, not all uncertainties can be expressed as probabilities, and not all model parameters measure what they purport to measure. These ideas are illustrated with examples from seismology, wind-turbine bird deaths, soccer penalty cards, gender bias in academia, and climate policy.


title: Exact Penalty Method for Federated Learning

abstract: Federated learning has burgeoned recently in machine learning, giving rise to a variety of research topics. Popular optimization algorithms are based on the frameworks of the (stochastic) gradient descent methods or the alternating direction method of multipliers. In this paper, we deploy an exact penalty method to deal with federated learning and propose an algorithm, FedEPM, that enables to tackle four critical issues in federated learning: communication efficiency, computational complexity, stragglers' effect, and data privacy. Moreover, it is proven to be convergent and testified to have high numerical performance.


title: The Effects of Correctly Modeling Generator Step-Up Transformer Status in Geomagnetic Disturbance Studies

abstract: In order to correctly model the impacts of geomagnetically induced current (GIC) flows, the generator step-up (GSU) transformer status must be properly modeled. In power flow studies, generators are typically removed from service without disconnecting their GSU transformers since the GSU transformer status has little to no impact on the power flow result. In reality, removing a generator from service involves also removing its GSU transformer from service. This difference presents a discrepancy between simulated behavior and system observations during geomagnetic disturbance (GMD) events. This paper presents GMD case studies on 2000-bus and 24,000-bus systems in which reactive power losses and geomagnetically induced currents are compared across scenarios in which the GSU transformers for the disconnected generators are either in-service or out-of-service. The results demonstrate a 3.2 to 15.5 percent error in reactive power losses when the GSU status is modeled incorrectly. Discrepancies of up to 95 A per phase for branch GIC flows and 450 A for transformer neutral GIC flows are also observed and visualized.


title: Revised calculation of the coefficient of parentage in plant breeding

abstract: The Coefficient of Parentage (COP) between two individuals is the expected inbreeding of their offspring. Originally exploited by animal breeders, is now a routine calculation among plant breeders as part of crop improvement programs. Here we show that the COP between strains requires a different calculation than the used to calculate the COP between individuals. Failure to do so may result in an overestimation of the amount of inbreeding. Here we provide a simple methodology to calculate the correct coefficient of parentage between strains.


title: Development of a Scanning Tunneling Microscope for Variable Temperature Electron Spin Resonance

abstract: Recent advances in increasing the spectroscopic energy resolution in scanning tunneling microscopy (STM) have been achieved by integrating electron spin resonance (ESR) with STM. Here, we demonstrate the design and performance of a home-built STM capable of ESR at temperatures ranging from 1 K to 10 K. The STM is incorporated with a home-built Joule-Thomson refrigerator and a 2-axis vector magnet. Our STM design allows for the deposition of atoms and molecules directly into the cold STM, eliminating the need to extract the sample for deposition. In addition, we adopt two methods to apply radio-frequency (RF) voltages to the tunnel junction, the early design of wiring to the STM tip directly, and a more recent idea to use an RF antenna. Direct comparisons of ESR results measured using the two methods and simulations of electric field distribution around the tunnel junction show that, despite their different designs and capacitive couplings to the tunnel junction, there is no discernible difference in the driving and detection of ESR. Furthermore, at a magnetic field of 1.6 T, we observe ESR signals (near 40 GHz) sustained up to 10 K, which is the highest temperature for ESR-STM measurement reported to date, to the best of our knowledge. Although the ESR intensity exponentially decreases with increasing temperature, our ESR-STM system with low noise at the tunnel junction allows us to measure weak ESR signals with intensities in the sub-fA range. Our new design of ESR-STM, which is operational in a large frequency and temperature range, can broaden the use of ESR spectroscopy in STM and enable the simple modification of existing STM systems, which will hopefully accelerate a generalized use of ESR-STM.


title: Preprocessing Source Code Comments for Linguistic Models

abstract: Comments are an important part of the source code and are a primary source of documentation. This has driven interest in using large bodies of comments to train or evaluate tools that consume or produce them -- such as generating oracles or even code from comments, or automatically generating code summaries. Most of this work makes strong assumptions about the structure and quality of comments, such as assuming they consist mostly of proper English sentences. However, we know little about the actual quality of existing comments for these use cases. Comments often contain unique structures and elements that are not seen in other types of text, and filtering or extracting information from them requires some extra care. This paper explores the contents and quality of Python comments drawn from 840 most popular open source projects from GitHub and 8422 projects from SriLab dataset, and the impact of na\"ive vs. in-depth filtering can have on the use of existing comments for training and evaluation of systems that generate comments.


title: Psychophysical Machine Learning

abstract: The Weber Fechner Law of psychophysics observes that human perception is logarithmic in the stimulus. We present an algorithm for incorporating the Weber Fechner law into loss functions for machine learning, and use the algorithm to enhance the performance of deep learning networks.


title: The Kolmogorov Birthday Paradox

abstract: We prove a Kolmogorov complexity variant of the birthday paradox. Sufficiently sized random subsets of strings are guaranteed to have two members x and y with low K(x/y). To prove this, we first show that the minimum conditional Kolmogorov complexity between members of finite sets is very low if they are not exotic. Exotic sets have high mutual information with the halting sequence.


title: $L^\infty$ Estimates for the Banach-valued $\bar\partial$ problem in a Disk

abstract: We study the differential equation $\frac{\partial G}{\partial\bar z}=g$ with an unbounded Banach-valued Bochner measurable function $g$ on the open unit disk $\mathbb D\subset\mathbb C$. We prove that under some conditions on the growth and essential support of $g$ such equation has a bounded solution given by a continuous linear operator. The obtained results are applicable to the Banach-valued corona problem for the algebra of bounded holomorphic functions on $\mathbb D$ with values in a complex commutative unital Banach algebra.


title: New Geometric Constant Related to the P-angle Function in Banach Spaces

abstract: In this paper, combined with the P-angle function of Banach spaces and the geometric constants that can characterize Hilbert spaces, the new angular geometric constant is defined. Firstly, this paper explores the basic properties of the new constant and obtains some inequalities with significant geometric constants. Then according to the derived inequalities, this paper studies the relationship between the new constant and the geometric properties of Banach spaces. Furthermore, the necessary and sufficient condition for uniform non-squareness, and the sufficient conditions for uniform convexity, the normal structure and the fixed point property will be established.


title: On the NLS approximation for the nonlinear Klein-Gordon equation

abstract: In this paper, developing a new approach based on Fourier analysis methods for dispersive PDEs, we establish a low regularity NLS approximation for the one-dimensional cubic Klein-Gordon equation. Our main result includes energy class solutions which are formally asymptotically in $L^2(\mathbb{R})$. A precise rate of convergence is also obtained assuming more regularity.


title: Your Blockchain Needn't Care How the Message is Spread

abstract: In a blockchain system, nodes regularly distribute data to other nodes. The ideal perspective taken in the scientific literature is that data is broadcast to all nodes directly, while in practice data is distributed by repeated multicast. Since correctness and security typically have been established for the ideal setting only, it is vital to show that these properties carry over to real-world implementations. This can be done by proving that the ideal and the real behavior are equivalent. In the work described in this paper, we take an important step towards such a proof by proving a simpler variant of the above equivalence statement. The simplification is that we consider only a concrete pair of network topologies, which nevertheless illustrates important phenomena encountered with arbitrary topologies. For describing systems that distribute data, we use a domain-specific language of processes that is embedded in a general-purpose process calculus. This allows us to leverage the rich theory of process calculi in our proof, which is machine-checked using the Isabelle proof assistant.


title: Bicycling geodesics are Kirchhoff rods

abstract: A bicycle path is a pair of trajectories in ${\mathbb R}^n$, the `front' and `back' tracks, traced out by the endpoints of a moving line segment of fixed length (the `bicycle frame') and tangent to the back track. Bicycle geodesics are bicycle paths whose front track's length is critical among all bicycle paths connecting two given placements of the line segment. We write down and study the associated variational equations, showing that for $n\geq 3$ each such geodesic is contained in a 3-dimensional affine subspace and that the front tracks of these geodesics form a certain subfamily of Kirchhoff rods, a class of curves introduced in 1859 by G. Kirchhoff, generalizing the planar elastic curves of J. Bernoulli and L. Euler.


title: A new explainable DTM generation algorithm with airborne LIDAR data: grounds are smoothly connected eventually

abstract: The digital terrain model (DTM) is fundamental geospatial data for various studies in urban, environmental, and Earth science. The reliability of the results obtained from such studies can be considerably affected by the errors and uncertainties of the underlying DTM. Numerous algorithms have been developed to mitigate the errors and uncertainties of DTM. However, most algorithms involve tricky parameter selection and complicated procedures that make the algorithm's decision rule obscure, so it is often difficult to explain and predict the errors and uncertainties of the resulting DTM. Also, previous algorithms often consider the local neighborhood of each point for distinguishing non-ground objects, which limits both search radius and contextual understanding and can be susceptible to errors particularly if point density varies. This study presents an open-source DTM generation algorithm for airborne LiDAR data that can consider beyond the local neighborhood and whose results are easily explainable, predictable, and reliable. The key assumption of the algorithm is that grounds are smoothly connected while non-grounds are surrounded by areas having sharp elevation changes. The robustness and uniqueness of the proposed algorithm were evaluated in geographically complex environments through tiling evaluation compared to other state-of-the-art algorithms.


title: Increasing the raw contrast of VLT/SPHERE with the dark-hole technique. II. On-sky wavefront correction and coherent differential imaging

abstract: Context. Direct imaging of exoplanets takes advantage of state-of-the-art adaptive optics (AO) systems, coronagraphy, and post-processing techniques. Coronagraphs attenuate starlight to mitigate the unfavorable flux ratio between an exoplanet and its host star. AO systems provide diffraction-limited images of point sources and minimize optical aberrations that would cause starlight to leak through coronagraphs. Post-processing techniques then estimate and remove residual stellar speckles such as noncommon path aberrations (NCPAs) and diffraction from telescope obscurations. Aims. We aim to demonstrate an efficient method to minimize the speckle intensity due to NCPAs during an observing night on VLT/SPHERE. Methods. We implement an iterative dark-hole (DH) algorithm to remove stellar speckles on-sky before a science observation. It uses a pair-wise probing estimator and a controller based on electric field conjugation. This work presents the first such on-sky minimization of speckles with a DH technique on SPHERE. Results. We show the standard deviation of the normalized intensity in the raw images is reduced by a factor of up to 5 in the corrected region with respect to the current calibration strategy under median conditions for VLT. This level of contrast performance obtained with only 1 min of exposure time reaches median performances on SPHERE that use post-processing methods requiring 1h-long sequences of observations. We also present an alternative calibration method that takes advantage of the starlight coherence and improves the post-processed contrast levels rms by a factor of about 3. Conclusions. This on-sky demonstration represents a decisive milestone for the future design, development, and observing strategy of the next generation of ground-based exoplanet imagers for 10m to 40m telescope.


title: Quasiperiodic sets at infinity and meromorphic extensions of their fractal zeta functions

abstract: In this paper we introduce an interesting family of relative fractal drums (RFDs in short) at infinity and study their complex dimensions which are defined as the poles of their associated Lapidus (distance) fractal zeta functions introduced in a previous work by the author. We define the tube zeta function at infinity and obtain a functional equation connecting it to the distance zeta function at infinity much as in the classical setting. Furthermore, under suitable assumptions, we provide general results about existence of meromorphic extensions of fractal zeta functions at infinity in the Minkowski measurable and nonmeasurable case. We also provide a sufficiency condition for Minkowski measurability as well as an upper bound for the upper Minkowski content, both in terms of the complex dimensions of the associated RFD. We show that complex dimensions of quasiperiodic sets at infinity posses a quasiperiodic structure which can be either algebraic or transcedental. Furthermore, we provide an example of a maximally hyperfractal set at infinity with prescribed Minkowski dimension, i.e., a set such that the abscissa of convergence of the corresponding fractal zeta function is in fact its natural boundary.


title: Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion

abstract: The matrix completion problem seeks to recover a $d\times d$ ground truth matrix of low rank $r\ll d$ from observations of its individual elements. Real-world matrix completion is often a huge-scale optimization problem, with $d$ so large that even the simplest full-dimension vector operations with $O(d)$ time complexity become prohibitively expensive. Stochastic gradient descent (SGD) is one of the few algorithms capable of solving matrix completion on a huge scale, and can also naturally handle streaming data over an evolving ground truth. Unfortunately, SGD experiences a dramatic slow-down when the underlying ground truth is ill-conditioned; it requires at least $O(\kappa\log(1/\epsilon))$ iterations to get $\epsilon$-close to ground truth matrix with condition number $\kappa$. In this paper, we propose a preconditioned version of SGD that preserves all the favorable practical qualities of SGD for huge-scale online optimization while also making it agnostic to $\kappa$. For a symmetric ground truth and the Root Mean Square Error (RMSE) loss, we prove that the preconditioned SGD converges to $\epsilon$-accuracy in $O(\log(1/\epsilon))$ iterations, with a rapid linear convergence rate as if the ground truth were perfectly conditioned with $\kappa=1$. In our experiments, we observe a similar acceleration for item-item collaborative filtering on the MovieLens25M dataset via a pair-wise ranking loss, with 100 million training pairs and 10 million testing pairs. [See supporting code at https://github.com/Hong-Ming/ScaledSGD.]


title: SwinFIR: Revisiting the SwinIR with Fast Fourier Convolution and Improved Training for Image Super-Resolution

abstract: Transformer-based methods have achieved impressive image restoration performance due to their capacities to model long-range dependency compared to CNN-based methods. However, advances like SwinIR adopts the window-based and local attention strategy to balance the performance and computational overhead, which restricts employing large receptive fields to capture global information and establish long dependencies in the early layers. To further improve the efficiency of capturing global information, in this work, we propose SwinFIR to extend SwinIR by replacing Fast Fourier Convolution (FFC) components, which have the image-wide receptive field. We also revisit other advanced techniques, i.e, data augmentation, pre-training, and feature ensemble to improve the effect of image reconstruction. And our feature ensemble method enables the performance of the model to be considerably enhanced without increasing the training and testing time. We applied our algorithm on multiple popular large-scale benchmarks and achieved state-of-the-art performance comparing to the existing methods. For example, our SwinFIR achieves the PSNR of 32.83 dB on Manga109 dataset, which is 0.8 dB higher than the state-of-the-art SwinIR method.


title: Secondary Protein Structure Prediction Using Neural Networks

abstract: In this paper we experiment with using neural network structures to predict a protein's secondary structure ({\alpha} helix positions) from only its primary structure (amino acid sequence). We implement a fully connected neural network (FCNN) and preform three experiments using that FCNN. Firstly, we do a cross-species comparison of models trained and tested on mouse and human datasets. Secondly, we test the impact of varying the length of protein sequence we input into the model. Thirdly, we compare custom error functions designed to focus on the center of the input window. At the end of paper we propose a alternative, recurrent neural network model which can be applied to the problem.


title: Elementary Proofs of Infinite Families of Congruences for Merca's Cubic Partitions

abstract: Recently, using modular forms and Smoot's {\tt Mathematica} implementation of Radu's algorithm for proving partition congruences, Merca proved the following two congruences: For all $n\geq 0,$ \begin{align*} A(9n+5) & \equiv 0 \pmod{3}, \\ A(27n+26) & \equiv 0 \pmod{3}. \end{align*} Here $A(n)$ is closely related to the function which counts the number of {\it cubic partitions}, partitions wherein the even parts are allowed to appear in two different colors. Indeed, $A(n)$ is defined as the difference between the number of cubic partitions of $n$ into an even numbers of parts and the number of cubic partitions of $n$ into an odd numbers of parts. In this brief note, we provide elementary proofs of these two congruences via classical generating function manipulations. We then prove two infinite families of non--nested Ramanujan--like congruences modulo 3 satisfied by $A(n)$ wherein Merca's original two congruences serve as the initial members of each family.


title: An Online Dynamic Amplitude-Correcting Gradient Estimation Technique to Align X-ray Focusing Optics

abstract: High-brightness X-ray pulses, as generated at synchrotrons and X-ray free electron lasers (XFEL), are used in a variety of scientific experiments. Many experimental testbeds require optical equipment, e.g Compound Refractive Lenses (CRLs), to be precisely aligned and focused. The lateral alignment of CRLs to a beamline requires precise positioning along four axes: two translational, and the two rotational. At a synchrotron, alignment is often accomplished manually. However, XFEL beamlines present a beam brightness that fluctuates in time, making manual alignment a time-consuming endeavor. Automation using classic stochastic methods often fail, given the errant gradient estimates. We present an online correction based on the combination of a generalized finite difference stencil and a time-dependent sampling pattern. Error expectation is analyzed, and efficacy is demonstrated. We provide a proof of concept by laterally aligning optics on a simulated XFEL beamline.